-- Logs begin at Tue 2022-09-20 04:12:50 UTC, end at Tue 2022-09-20 05:13:40 UTC. -- Sep 20 04:37:31.508990 dv-cinder-756710-7-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 20 04:37:31.517797 dv-cinder-756710-7-smb devstack@keystone.service[87773]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Sep 20 04:37:31 2022] *** Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: nodename: dv-cinder-756710-7-smb Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: machine: x86_64 Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: clock source: unix Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: pcre jit disabled Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: detected number of CPU cores: 4 Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: current working directory: / Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: detected binary path: /usr/bin/uwsgi-core Sep 20 04:37:31.519863 dv-cinder-756710-7-smb devstack@keystone.service[87773]: your processes number limit is 47680 Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: your memory page size is 4096 bytes Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: detected max file descriptor number: 2048 Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: lock engine: pthread robust mutexes Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: thunder lock: enabled Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 20 04:37:31.520455 dv-cinder-756710-7-smb devstack@keystone.service[87773]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 20 04:37:31.559561 dv-cinder-756710-7-smb devstack@keystone.service[87773]: Python main interpreter initialized at 0x555e35dc59c0 Sep 20 04:37:31.559561 dv-cinder-756710-7-smb devstack@keystone.service[87773]: python threads support enabled Sep 20 04:37:31.559561 dv-cinder-756710-7-smb devstack@keystone.service[87773]: your server socket listen backlog is limited to 100 connections Sep 20 04:37:31.559561 dv-cinder-756710-7-smb devstack@keystone.service[87773]: your mercy for graceful operations on workers is 90 seconds Sep 20 04:37:31.559934 dv-cinder-756710-7-smb devstack@keystone.service[87773]: mapped 403077 bytes (393 KB) for 2 cores Sep 20 04:37:31.560015 dv-cinder-756710-7-smb devstack@keystone.service[87773]: *** Operational MODE: preforking *** Sep 20 04:37:31.560285 dv-cinder-756710-7-smb devstack@keystone.service[87773]: *** uWSGI is running in multiple interpreter mode *** Sep 20 04:37:31.560285 dv-cinder-756710-7-smb devstack@keystone.service[87773]: spawned uWSGI master process (pid: 87773) Sep 20 04:37:31.560479 dv-cinder-756710-7-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 20 04:37:31.562000 dv-cinder-756710-7-smb devstack@keystone.service[87773]: spawned uWSGI worker 1 (pid: 87787, cores: 1) Sep 20 04:37:31.562000 dv-cinder-756710-7-smb devstack@keystone.service[87773]: spawned uWSGI worker 2 (pid: 87788, cores: 1) Sep 20 04:37:31.562000 dv-cinder-756710-7-smb devstack@keystone.service[87773]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 20 04:37:35.845248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:37:35.845248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: from cryptography.utils import int_from_bytes Sep 20 04:37:35.846070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:37:35.846070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: from cryptography.utils import int_from_bytes Sep 20 04:37:35.847098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:37:35.847098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: from cryptography.utils import int_from_bytes Sep 20 04:37:35.847557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 20 04:37:35.847557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: from cryptography.utils import int_from_bytes Sep 20 04:37:35.896029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:37:35.896224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:37:35.896422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] command line args: [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:37:35.896695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:37:35.896874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ================================================================================ {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:37:35.896959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 20 04:37:35.897129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] admin_token = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.897219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 20 04:37:35.897332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] command line args: [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 20 04:37:35.897414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] config_dir = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.897553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.897629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 20 04:37:35.897739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] config_source = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.897823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ================================================================================ {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 20 04:37:35.897921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] debug = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] admin_token = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] config_dir = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] config_source = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] debug = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.898989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] insecure_debug = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899549 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_config_append = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.899986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_dir = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_file = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_config_append = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_dir = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_file = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.900921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901508 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.901944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.902969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] notification_format = cadf {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.903934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] publish_errors = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.42/identity {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.904851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] publish_errors = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.905468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.905555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.905711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.905794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.905911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] standard_threads = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] standard_threads = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] use_journal = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] strict_password_check = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.906921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] use_json = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] use_stderr = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] use_eventlog = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] use_syslog = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] use_journal = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] use_json = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.907850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] use_stderr = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.907932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] use_syslog = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.908002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] watch_log_file = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 20 04:37:35.908241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.908955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.909926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.910890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.911998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.912965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.913921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.914845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.915080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.915327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.915572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.915819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.916050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.916297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.916541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.916775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.917021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.917249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.917484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.917718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.917946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.918176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.918404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.918633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.918780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.918868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.919900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.920119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.920198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.920382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.920551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.921847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.922845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.923905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.924966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.925914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.926926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.927967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.928944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.929904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.930855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.931930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.932917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.enabled = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.933897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.934944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.external = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.935904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.password = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] auth.token = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.936910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.937977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.938922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.939965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.external = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.mapped = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.940908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.password = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] auth.token = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.941918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] catalog.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.942857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.943911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.944928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.945955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.946920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.947974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.948863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.949986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.950943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.951931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.952983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.953913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.954895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.955994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.956978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.957951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.958904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.password = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.959869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.960884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.961990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.962947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.963946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.964968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.965915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.966882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.967037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.967114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.967284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.967370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.968054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.968137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.968309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.968550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.968793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.969031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] role.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.969496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] role.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.969739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.970814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.971016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.971084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.971358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.971626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.971907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.972174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.972419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] policy.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.973933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] receipt.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.974909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.975031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.975284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.975538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.975807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.975890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.976886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.977867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] revoke.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.978986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] role.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] role.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.979959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] role.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] role.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.980942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.981931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.982893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.983056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.983766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.983897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.983976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.connection = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.984921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.985890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.986858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.987980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:37:35.988688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.988915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.989154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.989404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.provider = fernet {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.989640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.989897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.990144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.990383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.990629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.990874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.991128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] trust.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.991366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.991610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.991883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.992134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.992411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.992642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.992888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.993161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.993413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.connection = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.993657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.993903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.994140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.994380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.994615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.994850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.995084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.995319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.995562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.995821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.996066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.996300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.996548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.996784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.997028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.997259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.997498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.997732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 20 04:37:35.997902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=87788) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 20 04:37:36.018061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.018291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.018518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.022778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.023016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.023244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.026815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.032020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.055658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.055913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.058189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.058423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.109336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.109783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.158329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.158563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.158700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.158938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.314884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.315981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.316065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.316204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.316420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.338750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.338981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.339964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.340091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.340173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.340345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.351191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.351434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.364377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.364564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.364649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.364792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.364886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87787) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.365880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=87788) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 20 04:37:36.383121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.383223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.383334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 04:37:36.383417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 04:37:36.383680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.383797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.383890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 04:37:36.383967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 20 04:37:36.384168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.384944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.385025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.395979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.396178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.396264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.403124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.403211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.406591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.406695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.406876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.406959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.407840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.408922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.409104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.409185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.409370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.409450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.431910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.432068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.433379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.433529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.433665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.433817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.438338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.438506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.438616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.438794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.438905 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.439081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.445263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.445440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.445553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.445728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.451229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.451420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.451530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.451719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.452383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.452560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.452672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.452850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.452954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.453941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.469711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.469895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.469979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.470175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.473837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.474038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.477080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.477271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.477379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.477570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.481576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.481784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.484738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.485040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.487989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.488943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.489134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.489217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.489425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.489507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.489714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.505112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.505399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.505482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.505668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.505749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.505930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.506012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.506249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.512766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.513127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.514318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.515186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.516364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.516642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.516750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.517029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.519677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.520007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.520290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.520972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.521254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.532672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.532958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.533042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.533894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.534172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.534262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.534450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.534532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.534730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.549882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.550106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.552794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.553040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.555684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.555934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.557187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.557377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.558648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.558844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.558926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.559129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.559317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.559524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.565705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.565912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.567160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.567372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.570048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.570447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.570738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.570818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.571018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.571180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.571470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.571768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.579346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.579652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.579962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.584188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.584493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.584776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.587968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87788) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.588259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.588542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.588820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.589095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.589372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.589824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.589921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.590192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.590475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.590754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.591026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.591292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.591575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87788) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.591867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=87787) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 20 04:37:36.592272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.593281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.593568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.593843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.594129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.594403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.594682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.594953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.595240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.595520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.595901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.596172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.596543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=87787) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 20 04:37:36.628493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e35dc59c0 pid: 87788 (default app) Sep 20 04:37:36.631414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x555e35dc59c0 pid: 87787 (default app) Sep 20 04:37:36.631778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113f14-33c2-4314-9c7a-6a508be1468f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:36.632067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113f14-33c2-4314-9c7a-6a508be1468f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:36.632337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe113f14-33c2-4314-9c7a-6a508be1468f None None] PATH_INFO: `/v3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:36.636485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 791 bytes} [Tue Sep 20 04:37:36 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:43.381440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:43.381959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:43.382065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:43.386273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1/2] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:37:43.392048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:43.392504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:43.392899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:43.462878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: INFO dbcounter [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] Registered counter for database keystone Sep 20 04:37:43.482154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG oslo_db.sqlalchemy.engines [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87788) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:37:43.488330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writer thread running {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:37:43.670241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG passlib.handlers.bcrypt [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87788) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 20 04:37:43.670534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG passlib.handlers.bcrypt [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87788) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 20 04:37:43.727911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:43.729613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:43.854852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:43 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 464 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 20 04:37:44.322317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:44.393933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: INFO dbcounter [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] Registered counter for database keystone Sep 20 04:37:44.415675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG oslo_db.sqlalchemy.engines [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 20 04:37:44.422018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writer thread running {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 20 04:37:44.540973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3a7eb1-5087-41b8-8c2a-640a1cd1e67a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:44.545257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:44.545905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:44.546711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:44.546986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:44.555123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:44.605939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING keystone.common.rbac_enforcer.enforcer [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 20 04:37:44.606270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b128f9cf-56bb-4d8b-b8a2-4ca4d2249658 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:44.616166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 2/4] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Sep 20 04:37:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 04:37:44.622077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:44.638504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9668b9c-8921-44a7-aa65-54e99373646d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:44.643145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:44.644278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:44.644555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:44.644823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] PATH_INFO: `/v3/projects/8b96017b54824414bda6d5bbb2079fd6` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:44.646374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] RBAC: Authorizing `identity:get_project(project_id=8b96017b54824414bda6d5bbb2079fd6)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:44.698610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING keystone.common.rbac_enforcer.enforcer [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 20 04:37:44.698947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735a6b7b-fda4-409b-8d56-f7ed3cccd3ed admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:44.703424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 3/5] 10.222.0.42 () {56 vars in 1207 bytes} [Tue Sep 20 04:37:44 2022] GET /identity/v3/projects/8b96017b54824414bda6d5bbb2079fd6 => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:46.814596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde537d3-4e0c-4af1-aab6-ab519238deb8 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:46.815132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde537d3-4e0c-4af1-aab6-ab519238deb8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:46.815132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde537d3-4e0c-4af1-aab6-ab519238deb8 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:46.819228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 3/6] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:37:46.824791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:46.825203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:46.825341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:46.845490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:46.847005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:46.854755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 20 04:37:47.125082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde537d3-4e0c-4af1-aab6-ab519238deb8 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:47.136959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde537d3-4e0c-4af1-aab6-ab519238deb8 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:47.141741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:47.142335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:47.142613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:47.143143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:47.150671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:47.152460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80a51fc-ccdf-4ca0-b867-3b4883147c96 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:47.161072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1324 bytes} [Tue Sep 20 04:37:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 04:37:47.166311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:47.175880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7a43b4-388b-44ee-b6a6-b5c8272cb6a5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:47.180189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:47.180814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:47.181095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:47.181367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:47.182664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:47.184531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a2a308d-ca21-4768-a8ed-96c74b573e11 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:47.186040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 5/9] 10.222.0.42 () {56 vars in 1198 bytes} [Tue Sep 20 04:37:47 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:49.389885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdc6bb-35b8-4fd9-a8b5-cd3348aa2a82 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:49.390436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdc6bb-35b8-4fd9-a8b5-cd3348aa2a82 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:49.390436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cacdc6bb-35b8-4fd9-a8b5-cd3348aa2a82 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:49.391795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 5/10] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:49.397275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:49.397700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:49.397814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:49.415785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:49.416948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:49.474805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0a36-ae8c-4012-8310-44995bf0f15c None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:49.475087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0a36-ae8c-4012-8310-44995bf0f15c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:49.475473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-736e0a36-ae8c-4012-8310-44995bf0f15c None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:49.478430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 6/11] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:37:49.481821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:49.482102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:49.482374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:49.499281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:37:49.524869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG passlib.handlers.bcrypt [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=87787) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 20 04:37:49.525268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG passlib.handlers.bcrypt [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=87787) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 20 04:37:49.573889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:49.575457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:49.673405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:49.765642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:49.790931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:49.870372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31c69fe-2da7-448c-8f0e-7a3078dba842 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:49.902597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:49.903223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:49.903500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:49.903800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:49.915049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:37:49.924366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:37:49.925388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:49.926408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:37:49.927875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 7/14] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:37:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:37:49.931179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:49.939100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.018588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.038797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ad4c0-b5ea-4004-94bb-882d6ce78a77 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.041612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99872ea2-f999-4ab2-ab0d-7c0bcbb7a3c1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.041760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.074878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.075481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.075786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.076059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.077065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.078490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.078765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.079144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.079907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:50.080205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.081644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.093359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 8/15] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:37:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:50.098820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.142890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.144646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.195819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1f127-bf5a-49c1-bf74-21b86d6004dc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.222766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.228940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.229788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.230062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.230327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.231831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.233271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.234861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 9/16] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:37:50 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:50.240316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.241975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 8/17] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:37:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 04:37:50.247237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.274801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.339757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df57c43-7254-4700-b204-49b9fc31d72c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.345245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c555641-b5df-4f3a-8a0d-73d9081d2166 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.372377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.373006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.373280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.373553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.374677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.376146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.377691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 10/18] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:50.378497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.379122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.379403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.379679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.383336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.390429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.391940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:37:50.408481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:37:50.409782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:37:50.410594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:37:50.410594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:37:50.410594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:37:50.410594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 9/19] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:37:50.416492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:50.451340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.484843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16e1262-01b9-4435-b0b3-dd9655fc34ba None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.486319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:50.519201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39acb2a0-a77c-48e7-913f-74a7ad0a9342 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:50.519350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.519882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.520159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.520429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.521143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.domain.id=default, user.id=f5af3cffbb0b41788f819ee8fb479d3a) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:50.521449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.522871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc4b4bc-d7c9-487c-a3fa-c2f8802adb7b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.531843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 11/20] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Sep 20 04:37:50 2022] GET /identity/v3/role_assignments?user.id=f5af3cffbb0b41788f819ee8fb479d3a&scope.domain.id=default&role.id=307985de8d134d4587aac9def1fcad5c => generated 233 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:50.553519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:50.554180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:50.554456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:50.554726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:50.555379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:50.555677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:50.557116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b503048-8ad3-48ea-a67a-edb6750a6b71 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:50.576480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 10/21] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:53.110085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b372-5069-41db-9e7d-174c0c3cb7de None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.110611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b372-5069-41db-9e7d-174c0c3cb7de None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.110611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c6b372-5069-41db-9e7d-174c0c3cb7de None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.112304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 12/22] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:53.117755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d915c-d7e3-4018-a1e9-0ba042757a5f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.118228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d915c-d7e3-4018-a1e9-0ba042757a5f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.118319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57d915c-d7e3-4018-a1e9-0ba042757a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.144896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f57d915c-d7e3-4018-a1e9-0ba042757a5f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:53.146149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f57d915c-d7e3-4018-a1e9-0ba042757a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:53.234366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 11/23] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:37:53.235939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040af2d5-928f-4825-9343-22b5d4bb5548 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.236226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040af2d5-928f-4825-9343-22b5d4bb5548 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.236498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040af2d5-928f-4825-9343-22b5d4bb5548 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.238088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:53.243224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.243511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.243809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.245572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c916e7-9733-47e7-85f9-24bbc3991cb7 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.245856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c916e7-9733-47e7-85f9-24bbc3991cb7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.246129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c916e7-9733-47e7-85f9-24bbc3991cb7 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.247552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 14/25] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:53 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:37:53.265696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:53.266416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde722c-cbf0-403e-8ad9-25b0e991f463 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.266706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde722c-cbf0-403e-8ad9-25b0e991f463 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.266874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:53.266966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdde722c-cbf0-403e-8ad9-25b0e991f463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.285109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:53.311804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cdde722c-cbf0-403e-8ad9-25b0e991f463 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:53.313566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cdde722c-cbf0-403e-8ad9-25b0e991f463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:53.368118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 12/26] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:37:53.412044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 15/27] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:53.685090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:53.751658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d474-8027-4869-90b8-dba4243f7fd4 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.751998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d474-8027-4869-90b8-dba4243f7fd4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.752231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c324d474-8027-4869-90b8-dba4243f7fd4 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.753779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 16/28] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:37:53.760778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.761306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.761769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.794612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:53.801630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:53.826757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d36eb6-989f-4441-a630-197e9c6cd02f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:53.884390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:53.885032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:53.885304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:53.885725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:53.895102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 17/29] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:53.896260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:53.896887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:37:53.901839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:37:53.902683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:37:53.903425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 13/30] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:37:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:37:53.904090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:53.932129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:53.961241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.003210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331cc42-f40b-4f47-ae84-98bc4d2fa349 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.062634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.063677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.064177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.064653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.065506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.067118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.128011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3142a79b-aa1b-48fa-858b-96b449e0a99e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.202494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 18/31] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 20 04:37:53 2022] POST /identity/v3/roles => generated 219 bytes in 306 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:37:54.204153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.213237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.213812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.214091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.214361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.242005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.243630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:37:54.275515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:37:54.276464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:37:54.277260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:37:54.277260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:37:54.277260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:37:54.282044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 14/32] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 378 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:37:54.283272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.309959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.328028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea83f88-4f6d-456d-b40b-7fa1627d818f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.366281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.367350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.367901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.368371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.369269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:54.369784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.371610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.382667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 19/33] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:37:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:54.383945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.431287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.482967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7df1ce-618d-4a66-9349-f3a643b8a447 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.507397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7068e9f-9354-4738-bbc9-172be3f51b2b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.534580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.535445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.536030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.536649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.538024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.539685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.551842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.553685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.554293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.554868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.555987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:54.556423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.558222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.582162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 20/34] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:54.583346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.598435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.689629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 15/35] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 20 04:37:54 2022] POST /identity/v3/roles => generated 225 bytes in 407 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:37:54.691126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.694379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39ad5cd-ea15-43f7-bbaa-85b860bfb623 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.735546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.736300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.736649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.736990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.738436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.740081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.742283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 21/36] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:37:54 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:54.749159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.846804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802d8024-27d7-43f0-b6ab-7157c274e19b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.852155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.877355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019d66d7-a79a-4a6c-a5e6-1e20a6787e1d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:54.893954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:54.916699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.917382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.918134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.918814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.920335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.922531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513e9ae6-6260-468b-b2fa-249b457dee3f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.923769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:54.924803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.925304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.925774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.927407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:54.929315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:54.931716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 22/37] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:54.937177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:54.985150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 16/38] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:37:54 2022] POST /identity/v3/projects => generated 301 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:37:54.986933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d155-01de-4bbc-8018-f29fb03a866d None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.987426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d155-01de-4bbc-8018-f29fb03a866d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.987705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5d155-01de-4bbc-8018-f29fb03a866d None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:54.989339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 17/39] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:54.997275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:54.997909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:54.998386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.101409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728c75d-9a56-4168-aff6-3323dca57ed0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:55.137190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:55.140019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:55.142082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:55.142782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.143064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.143603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] PATH_INFO: `/v3/domains/default/users/f5af3cffbb0b41788f819ee8fb479d3a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.146007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=f5af3cffbb0b41788f819ee8fb479d3a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:55.147235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d11ae0-08eb-4aef-914f-d117d4197a28 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:55.164675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 23/40] 10.222.0.42 () {58 vars in 1361 bytes} [Tue Sep 20 04:37:54 2022] PUT /identity/v3/domains/default/users/f5af3cffbb0b41788f819ee8fb479d3a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:37:55.166063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d563-4a39-45ab-871d-af4124bf67dc None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.166419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d563-4a39-45ab-871d-af4124bf67dc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.166698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370d563-4a39-45ab-871d-af4124bf67dc None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.168082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 24/41] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:55.178134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.178477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.178760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.192655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:55.210675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:55.212232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:55.248758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 18/42] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:55.300055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 25/43] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:55.519009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:55.573384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:55.623785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7681c7-293a-4812-bddc-7a99ccd92fec None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:55.634762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:55.664583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:55.665199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.665484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.665775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.666518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:55.667919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:55.684160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 19/44] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 20 04:37:55 2022] POST /identity/v3/roles => generated 223 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:37:55.686565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6f0e01-4753-4538-a751-bfea0674badc None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:55.725408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:55.726067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.726356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.726629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.727804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:55.729274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a182ae8b-175b-4267-b828-1cf7524d7987 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:55.731063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 26/45] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:55.737357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:55.848175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3926f5-8c49-4642-bd92-4ef9a0ca41e1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:55.885110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:55.885735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:55.886021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:55.886298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:55.886967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:55.888463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e02a9-e969-450e-878d-4fee4077094d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:55.920949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 20/46] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:37:55 2022] POST /identity/v3/projects => generated 312 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:37:57.313606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981f1a-3ff1-4299-adf4-2eb74b6e2491 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:57.314169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981f1a-3ff1-4299-adf4-2eb74b6e2491 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:57.314169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa981f1a-3ff1-4299-adf4-2eb74b6e2491 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:57.315487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 27/47] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:57.322025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:57.322428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:57.322689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:57.340825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:57.342003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:57.355587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:57.407018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 21/48] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:37:57.670864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa981f1a-3ff1-4299-adf4-2eb74b6e2491 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:57.674322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:57.771064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa981f1a-3ff1-4299-adf4-2eb74b6e2491 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:57.803363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:57.804024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:57.804306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:57.804577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:57.815942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:37:57.824769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:37:57.825769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:37:57.826703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 28/49] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:37:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:37:57.832304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:57.939784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64582641-abe6-4e96-8609-5ae839d90b47 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:57.973406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:57.974038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:57.974315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:57.974585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:57.975264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:57.975566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:57.977039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a7ace-d020-4aa0-a003-7ce7c28adda8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:57.990422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 22/50] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:37:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:57.996402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:58.060966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:58.093335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca2d0-b4e2-424f-a2dd-5e42acb45d57 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.093625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca2d0-b4e2-424f-a2dd-5e42acb45d57 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.093902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eeca2d0-b4e2-424f-a2dd-5e42acb45d57 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.095237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 23/51] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:37:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:37:58.100143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.100424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.100698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.104467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf40aea-349c-4289-8f15-3fea5ae19302 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:58.118785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:37:58.119999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:37:58.127678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:58.137898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:58.138534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.138812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.139083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.140846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:58.142296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:58.144299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 29/52] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:37:57 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:58.149486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:58.187320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 24/53] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:37:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:37:58.248780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a1999a-a0f4-403b-8e7f-f4173cbc5bba None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:58.275686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:58.282307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:58.282937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.283221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.283499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.284661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:58.286112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:58.287683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 30/54] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:37:58.293561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:58.388740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583d5d5a-055f-4ec7-a407-59f109f754ed None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:58.421890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:58.422502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.422785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.423063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.423825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.domain.id=default, user.id=f5af3cffbb0b41788f819ee8fb479d3a) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:37:58.424140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:58.425580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:58.434823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 25/55] 10.222.0.42 () {56 vars in 1322 bytes} [Tue Sep 20 04:37:58 2022] GET /identity/v3/role_assignments?user.id=f5af3cffbb0b41788f819ee8fb479d3a&scope.domain.id=default&role.id=307985de8d134d4587aac9def1fcad5c => generated 530 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:58.465106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:58.570172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5772dc77-8275-4bc8-af68-b2ff786be2a6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:58.604929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:58.605561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.605845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.606120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.607223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:58.608706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e87d9e-3e5b-4837-9169-e0651b020de1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:58.610924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 31/56] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:37:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:37:58.616554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:37:58.626469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:37:58.717054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5179d5-04f6-4498-a26c-9880c350c728 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:37:58.749381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:37:58.750002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:37:58.750282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:37:58.750554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:37:58.751210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:37:58.752672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c23bb75-5e82-4307-82ab-3c0769420df5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:37:58.778212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 26/57] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Sep 20 04:37:58 2022] POST /identity/v3/projects => generated 298 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:00.915536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf120f-dc31-4219-8979-700b35f08a13 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:00.916098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf120f-dc31-4219-8979-700b35f08a13 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:00.916182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bf120f-dc31-4219-8979-700b35f08a13 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:00.917459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 32/58] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:00.923184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:00.923616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:00.923759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:00.942084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:00.943278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:00.994278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:01.009281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 27/59] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:01.284828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf120f-dc31-4219-8979-700b35f08a13 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:01.348782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:01.384805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bf120f-dc31-4219-8979-700b35f08a13 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:01.417018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:01.417627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:01.417906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:01.418184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:01.419283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:01.420746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-127f5e89-fd12-418e-9087-8c82b236c009 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:01.422846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 33/60] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:01.428308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:01.523094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f3ae1d-4480-4a79-9cfa-fd0e90ab9398 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:01.555598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:01.556161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:01.556439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:01.556708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:01.557362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:01.558795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76980b5-51b3-46a4-a080-e4e76c1f57cb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:01.585066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 28/61] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:01 2022] POST /identity/v3/users => generated 275 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:38:04.880135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183091b-52ed-4562-851a-c4fe91e004b6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:04.881141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183091b-52ed-4562-851a-c4fe91e004b6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:04.881629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a183091b-52ed-4562-851a-c4fe91e004b6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:04.883416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 34/62] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:04.889047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d343-517b-4330-8f2d-11dda774521a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:04.889865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d343-517b-4330-8f2d-11dda774521a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:04.890385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d343-517b-4330-8f2d-11dda774521a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:04.902608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e77bf-48d4-47ee-a027-9237014be143 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:04.903205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e77bf-48d4-47ee-a027-9237014be143 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:04.903677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8e77bf-48d4-47ee-a027-9237014be143 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:04.905505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 35/63] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:04.911412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c07dd-9646-4e3a-bc30-8afdb25d42f9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:04.911702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c07dd-9646-4e3a-bc30-8afdb25d42f9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:04.911997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57c07dd-9646-4e3a-bc30-8afdb25d42f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:04.920844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1244d343-517b-4330-8f2d-11dda774521a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:04.926010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1244d343-517b-4330-8f2d-11dda774521a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:05.036117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:05.076703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b57c07dd-9646-4e3a-bc30-8afdb25d42f9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:05.078479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b57c07dd-9646-4e3a-bc30-8afdb25d42f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:05.094452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 29/64] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:05.181679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 36/65] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 271 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:05.262878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84876b98-f97c-49b5-b7ea-8ea7cb691114 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.263178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84876b98-f97c-49b5-b7ea-8ea7cb691114 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.263442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84876b98-f97c-49b5-b7ea-8ea7cb691114 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.264843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 30/66] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:05.271009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.271538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.272041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.304760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:05.306607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:05.350454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe778c-18cc-4c3b-af12-f5e05555fd0a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.350762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe778c-18cc-4c3b-af12-f5e05555fd0a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.351016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fe778c-18cc-4c3b-af12-f5e05555fd0a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.352410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 31/67] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:05.369075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.369633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.370109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.379650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:05.391653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 37/68] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:05.409645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:05.410846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:05.426067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.536536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 32/69] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:05.537849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.564394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d2e69-bd24-46d1-82c6-f77f5c5bb280 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:05.604614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:05.605689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.606169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.606677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.618808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:05.624000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:05.624877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:05.625664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:05.627914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 38/70] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:05.637913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.695072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91c4dc1-9eed-4f35-a07e-47702db69c02 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:05.698538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:05.723524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:05.738079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:05.738716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.739000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.739274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.749483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-28aeb446-d48c-4ee8-904c-32e421d05476 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:05.754345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:05.755169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:05.755973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 33/71] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:05.757138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f4d10-93f6-4ccf-9021-8a12f47ffc4b None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.757427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f4d10-93f6-4ccf-9021-8a12f47ffc4b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.757702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1f4d10-93f6-4ccf-9021-8a12f47ffc4b None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.759095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 34/72] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:05.759683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f4d10-93f6-4ccf-9021-8a12f47ffc4b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.790204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63befa75-9567-428b-9ab4-ab1e62403cea None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:05.827288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:05.827945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.828228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.828499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.829160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:05.829463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:05.830835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9af8990-a0a9-4c70-b490-e7c02b2223c1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:05.843990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 39/73] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:05.843990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.843990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.843990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.859913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:05.861096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:05.868574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1f4d10-93f6-4ccf-9021-8a12f47ffc4b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:05.902698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:05.903420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:05.903706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:05.904013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:05.914345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:05.919199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:05.920066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:05.920830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 35/74] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:05.921488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.928897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 40/75] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:05.936658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:05.947766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:05.987800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.028954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f85ce5-b0b7-4b7f-8cb1-6199cf24c98d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.046142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c45fb45-401c-4ec6-9e2a-c84a2dd3b11f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.066988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.067712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.068021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.068297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.069022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:06.069330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.070977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.084339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 36/76] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.084339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.086955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.087603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.087957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.088238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.089431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.090895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.092510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 41/77] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:05 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.093445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.179434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.196570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e83825-62b6-46cf-bf5b-ba0ebad141dd None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.206613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a0ef2-1eb2-4e02-aa52-c9632b52765b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.221008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.231873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.232508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.232871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.233061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.241010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.241614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.241894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.242171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.242830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:06.242929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:06.243133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.244525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:06.248097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:06.249136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:06.250248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 37/78] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:06.251021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.254408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 42/79] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.255124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.347977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2918cf2-3db0-4a3c-872f-83e29e00468e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.352300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6aad64d-4b1a-42c7-99fb-071e38e3f473 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.379625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.380269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.380547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.380820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.384894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.385492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.385777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.386057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.394657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.396138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.397738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 38/80] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.398489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.401879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.435117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.460578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.461990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.498405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca0b84-5513-4e98-9319-5dce47425051 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.532609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.533242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.533524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.533796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.534924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.536404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.538116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 39/81] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.538714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.561628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 43/82] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:06.562466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.607609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.638170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde90370-02c4-4f51-80e0-4a7c76a4fa7a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.640484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.665057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdc6bc9-bda5-41d0-82dd-44f3c9063f15 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.672567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.673184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.673463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.673736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.674397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:06.674701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.676101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.683924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 40/83] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.684746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.698934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.699625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.699954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.700237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.701374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.703317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.704922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 44/84] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:06.705661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.786810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441d883e-86b4-49ba-8241-6a9fa2a4ff13 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.802144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24712965-10e0-4e55-83d6-27263613af13 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:06.819932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.820532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.820809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.821080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.823592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.836399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:06.837005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:06.837292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:06.837566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:06.838221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.839661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:06.862201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:06.883978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 45/85] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:06 2022] POST /identity/v3/users => generated 289 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:06.885266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:06.892808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:06.894594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.005350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1251f4-34f3-45c0-b38c-cd0c6c4368b2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.020693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 41/86] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:07.020693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.051541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.052143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.052433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.052710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.053882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.055328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.056735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.057171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 46/87] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:06 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:07.058874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.147940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e5f50a-b859-4407-9f55-c5f74bc22ef0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.153339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.194907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.195355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3261b652-2ab9-4e2a-9c0c-e4b102bf92b1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.195561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.196535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.196535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.198734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.200447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.201550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 42/88] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:07.203858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.241711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.242422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.242710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.242985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.317642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0a43a3-2cad-4783-b7f0-b2d83ebd86aa None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.319266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.339006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.340573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.369449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.370090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.370487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.370771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.372015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.373528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.375532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 43/89] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:07.376247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.419699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.465410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 47/90] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:07.466466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.505201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182d6375-1060-4e04-a246-09adcb96003c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.541666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.542342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.542834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.542955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.543640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=f5af3cffbb0b41788f819ee8fb479d3a) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:07.543968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.545440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.551145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 44/91] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/role_assignments?user.id=f5af3cffbb0b41788f819ee8fb479d3a&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:07.552339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.591535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fbb0c9-f997-431d-9d10-a50166bbbad8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.601269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.629831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.630512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.630796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.631128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.692198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.711576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb214184-9d62-47eb-b3b3-4493b0897061 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.726469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.728315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.780493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:07.782075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:07.782556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:07.783034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:07.785018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:07.785610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:07.789077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:07.800162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 45/92] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=791fea6050e741c0824356b63aa26aea => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:07.805219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:07.953930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:07.958998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb5c27f-7a55-4e8d-8c01-38a83a54c6d6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:07.975576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 48/93] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 510 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:08.001292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:08.011602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:08.012374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:08.012723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:08.013065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:08.020595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:08.022745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:08.024722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 46/94] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:07 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:08.031358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:08.136111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:08.174944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861fee80-9d60-4077-898d-eaa4e604af89 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:08.212211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c357cd7b-1d44-401e-9960-ecf2729cb4c5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:08.212873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:08.213825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:08.214303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:08.214821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] PATH_INFO: `/v3/projects/d6886e13c71946c694a7855f317ca6ea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:08.216239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] RBAC: Authorizing `identity:get_project(project_id=d6886e13c71946c694a7855f317ca6ea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:08.217981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:08.219938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 49/95] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:08 2022] GET /identity/v3/projects/d6886e13c71946c694a7855f317ca6ea => generated 312 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:08.236939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:08.273784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:08.274415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:08.274731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:08.275003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:08.275761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:08.276076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:08.282236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d582f9ab-93c1-4ebc-9397-0dc8986306b3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:08.289293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 47/96] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:08 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=7da111f273124548ab0a4deafd90a54f => generated 259 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:08.393408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055af065-79ac-498b-b538-ee322a696dd9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:08.451751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:08.451751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:08.451751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:08.451751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:08.452201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=d6886e13c71946c694a7855f317ca6ea, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:08.452201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:08.452201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea082424-aa92-4e69-a883-204e6a3e506b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:08.452201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:08.459005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 50/97] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:08 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=d6886e13c71946c694a7855f317ca6ea&role.id=791fea6050e741c0824356b63aa26aea => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:09.756169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364046-07b0-40c0-9d00-a17b71e4d4f7 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:09.756678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364046-07b0-40c0-9d00-a17b71e4d4f7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:09.756781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7364046-07b0-40c0-9d00-a17b71e4d4f7 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:09.758079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 48/98] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:09.763534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5988-7c6d-4925-9201-39b8894b1468 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:09.763970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5988-7c6d-4925-9201-39b8894b1468 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:09.764140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a5988-7c6d-4925-9201-39b8894b1468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:09.792863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1e0a5988-7c6d-4925-9201-39b8894b1468 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:09.794181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1e0a5988-7c6d-4925-9201-39b8894b1468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:09.882294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 51/99] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:10.044075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f5cb-b11e-44e4-bb89-6263d1b6c5d2 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.044359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f5cb-b11e-44e4-bb89-6263d1b6c5d2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.044570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd93f5cb-b11e-44e4-bb89-6263d1b6c5d2 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.046094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 49/100] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:10.051660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.051995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.052278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.074827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:10.076059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:10.154009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 52/101] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:10.291111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93f5cb-b11e-44e4-bb89-6263d1b6c5d2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:10.325395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:10.420970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd93f5cb-b11e-44e4-bb89-6263d1b6c5d2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:10.482596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:10.483577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.484110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.484589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.499010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:10.504671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:10.505558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:10.506319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:10.508558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 50/102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:10.516986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:10.532006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:10.647389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:10.697704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:10.716132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da5bcb8-d38c-4a7d-ae45-31e208402d73 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:10.736133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f2e93-611c-4be6-a16d-3a7e36c56331 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:10.762633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:10.763209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.763431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.763693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.765003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:10.766498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:10.768409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 51/103] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:10.777249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:10.861623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:10.862292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.862567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.862862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.863512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] RBAC: Adding query filter params (name=reader) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:10.863836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:10.865204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:10.882672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 53/104] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:10 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:10.888222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:10.930216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1830fcfb-4eea-4b3f-a0fc-685e3b7f869e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:10.969940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:10.970575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:10.970866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:10.971144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:10.971844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:10.973339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:11.008522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 52/105] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:38:10 2022] POST /identity/v3/projects => generated 302 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:11.090633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a33ce4b-9070-497f-a0f8-d00f9e328f5b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:11.127324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:11.145579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:11.146266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.146545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.146816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] PATH_INFO: `/v3/users/0aaf48fe968a417fa31da8c18fa3048b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.168860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] RBAC: Authorizing `identity:get_user(user_id=0aaf48fe968a417fa31da8c18fa3048b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:11.170366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e6d44-e866-47bf-bfe0-8af571a1255d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:11.173182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 54/106] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:10 2022] GET /identity/v3/users/0aaf48fe968a417fa31da8c18fa3048b => generated 289 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:11.179218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:11.199107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:11.273677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73fbc-e58f-4c40-8ee3-5367f90c8198 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.273960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73fbc-e58f-4c40-8ee3-5367f90c8198 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.274236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c73fbc-e58f-4c40-8ee3-5367f90c8198 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.275702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 55/107] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:11.285174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2626c-7bf8-447b-9bdf-3039916406a9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.285453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2626c-7bf8-447b-9bdf-3039916406a9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.285725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f2626c-7bf8-447b-9bdf-3039916406a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.337029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a8f1bd-0b3a-421d-a55a-1926ac46ea50 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:11.339762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e2f2626c-7bf8-447b-9bdf-3039916406a9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:11.341559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e2f2626c-7bf8-447b-9bdf-3039916406a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:11.401492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:11.402218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.402501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.402870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.447982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 56/108] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:11.449045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4d88-3ebf-4e41-a18d-5ba6b615ad75 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.449399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4d88-3ebf-4e41-a18d-5ba6b615ad75 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.449622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50d4d88-3ebf-4e41-a18d-5ba6b615ad75 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.451853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 57/109] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:11.465377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.465668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.465950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.501668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:11.502888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:11.542878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:11.544623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5bc60e4-3aab-4616-9e07-d16c368edff7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:11.558882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:11.658777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 58/110] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:11.706977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 53/111] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 528 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:11.712640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:11.740501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d594-c889-4e7a-8718-06bb446b0c2b None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.740817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d594-c889-4e7a-8718-06bb446b0c2b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.741060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f2d594-c889-4e7a-8718-06bb446b0c2b None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.742613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 54/112] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:11.747694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8ef2-d602-49af-a557-69bdb7d52cc4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.748004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8ef2-d602-49af-a557-69bdb7d52cc4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.748271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ca8ef2-d602-49af-a557-69bdb7d52cc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.771084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:11.782641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b9ca8ef2-d602-49af-a557-69bdb7d52cc4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:11.783880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b9ca8ef2-d602-49af-a557-69bdb7d52cc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:11.838972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be59a8b-695a-4e21-bd5d-333971b5f432 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:11.884503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:11.885252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:11.885441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:11.885719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:11.888907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:11.890459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:11.892239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 59/113] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:11 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:11.898978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:11.936527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 55/114] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:12.008352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b75e-c425-45d6-bba4-a1873a11fae0 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.008970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b75e-c425-45d6-bba4-a1873a11fae0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.009190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a011b75e-c425-45d6-bba4-a1873a11fae0 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.010649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 56/115] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:12.016518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.016518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.016959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.036393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f038320-3950-43aa-a679-7ca8b1dbd1c4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.040026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:12.041244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:12.047871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.089278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.090137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.090610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.091035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.091947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=0aaf48fe968a417fa31da8c18fa3048b) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:12.092432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:12.094222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:12.095698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.100604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 60/116] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:11 2022] GET /identity/v3/role_assignments?user.id=0aaf48fe968a417fa31da8c18fa3048b&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=c40662578aa541a1897ea45391239390 => generated 259 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:12.101724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.140881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 57/117] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:12.141902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.254944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5bbc062-b9cd-4d2b-b178-1d1b62b7bdbb None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.294812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.295808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.296192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.296568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.310183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:12.311494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39e220d2-9668-47ba-8d16-0c8546a67e7e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:12.316156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:12.324611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 58/118] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:12.326336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.387968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.389573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.391392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.392332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.407035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.425365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:12.447990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:12.448849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:12.449625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:12.456444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 61/119] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:12.467667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.537036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.554593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41df4a13-3a2e-436d-801a-3980bd2590ac None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.606908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.607684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.608086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.608455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.609959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:12.610365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:12.611908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:12.620135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 59/120] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:12.621022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.623319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f26d31-c602-484c-b824-6ebb48e26cd2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.666095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.666855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.667237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.667760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.668515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] RBAC: Adding query filter params (name=member) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:12.668941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:12.670644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:12.681159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 62/121] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:12.682090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.725836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.736400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4549d094-f6c3-4340-adae-b9cc257b25f4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.774108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.774745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.775029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.775304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.786556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:12.792396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:12.793278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:12.794048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 60/122] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:12.799602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.803752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:12.813308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa6c9a0-c0ee-46d8-9cd0-886a52a90926 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.855686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.857293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.857802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.858275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.871128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:12.878167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:12.879078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:12.879888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:12.887082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 63/123] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:12.888676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.911841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ebf86b-2a3c-46c6-9c17-051b98ad233e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:12.954986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:12.956366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:12.956851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:12.957490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:12.959435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:12.961584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:12.963962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 61/124] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:12.968963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:12.997513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.012031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56723eed-68d9-4fa1-a190-1b2bf0b9c1a8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.049555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.050474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.050651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.050880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.052073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.053535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.055299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 64/125] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.056442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.084549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.101158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b98020d-07ca-443c-92df-4d38bef88d10 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.148621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.149756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.150182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.150620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.152137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:13.152595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.154654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.166345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 62/126] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.171462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.177165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ec6b6-c631-49b8-be2d-e63295542d28 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.223366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.225267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.226078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.226819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.227704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:13.228381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.230660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.241961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 65/127] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.247030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.279362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.302738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89d274f-2c74-46ef-a4ec-5efe7c70e76d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.347126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.350136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.351139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.351518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.351931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.353923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.355658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.362741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 63/128] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.362741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.370073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44029-49ca-4d7d-907e-2c5b87320bd3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.412978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.414020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.414595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.415068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.416491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.418392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.420506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 66/129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.422308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.482246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878daff1-a2b3-4880-b7a6-fa2c5baacd6d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.525874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.526770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.527057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.527331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.528674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.530438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.535799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 64/130] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.535799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.552066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2869aac-ec98-4605-97b7-538516483576 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.558766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.597995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.598861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.599247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.599648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.601084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.602948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.609221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 67/131] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:13.609221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.633373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.673870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d353d88b-5a9a-49b4-899b-aa930d57e79e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.718410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.719935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.720385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.720799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/users/f5af3cffbb0b41788f819ee8fb479d3a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.721016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d6c52-9a00-4448-9208-46be24125a33 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.724021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, user_id=f5af3cffbb0b41788f819ee8fb479d3a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.725402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.744055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 65/132] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:13 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/users/f5af3cffbb0b41788f819ee8fb479d3a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:13.748565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.779345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:13.783423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:13.784124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:13.784618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/users/34bfe61c82534b93a479bdd6b667ca12/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:13.790192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, user_id=34bfe61c82534b93a479bdd6b667ca12, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:13.792685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:13.819926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 68/133] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:13 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/users/34bfe61c82534b93a479bdd6b667ca12/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:13.821177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:13.928220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.962413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:13.967271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad376421-9632-456c-90ca-dfe53db77836 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:13.999455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f642d12-59d0-45e7-b2c3-b8d1a8c54ecb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:14.019763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:14.020455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.020739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.021015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] PATH_INFO: `/v3/projects/d6886e13c71946c694a7855f317ca6ea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.022198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] RBAC: Authorizing `identity:get_project(project_id=d6886e13c71946c694a7855f317ca6ea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:14.023673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7ebb11-7aaf-4f94-886f-7da9df3b79d7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:14.030387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 66/134] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/projects/d6886e13c71946c694a7855f317ca6ea => generated 312 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:14.032410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf92b4-a31a-4565-b0b9-dfcd591e33a0 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.032708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf92b4-a31a-4565-b0b9-dfcd591e33a0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.032994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadf92b4-a31a-4565-b0b9-dfcd591e33a0 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.034343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 67/135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:14.035450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf92b4-a31a-4565-b0b9-dfcd591e33a0 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:14.045834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:14.047406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.048278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.048736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.050852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:14.052808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b4c39a-3293-4e61-ae5e-36f19def0212 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:14.055470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 69/136] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:13 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:14.057079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.057542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.058430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.086740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:14.088283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:14.173865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadf92b4-a31a-4565-b0b9-dfcd591e33a0 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:14.183245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 70/137] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:14.184427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:14.268118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:14.271238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:14.272191 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.272485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.272768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] PATH_INFO: `/v3/projects/d6886e13c71946c694a7855f317ca6ea/users/34bfe61c82534b93a479bdd6b667ca12/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.278255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] RBAC: Authorizing `identity:create_grant(project_id=d6886e13c71946c694a7855f317ca6ea, user_id=34bfe61c82534b93a479bdd6b667ca12, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:14.279739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:14.305691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 68/138] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:14 2022] PUT /identity/v3/projects/d6886e13c71946c694a7855f317ca6ea/users/34bfe61c82534b93a479bdd6b667ca12/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:38:14.314984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff477081-65db-4c97-a5d8-03023500fa67 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:14.381672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:14.382543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.382833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.383207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/users/34bfe61c82534b93a479bdd6b667ca12/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.385697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, user_id=34bfe61c82534b93a479bdd6b667ca12, role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:14.392798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059a636c-10da-40c4-9ca8-cef08ce8667b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:14.414014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 71/139] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:14 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/users/34bfe61c82534b93a479bdd6b667ca12/roles/7da111f273124548ab0a4deafd90a54f => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:14.630158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:14.640480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:14.751719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7fded1-24f9-4644-b750-a91c8c4c10df None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:14.762764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d96e4-ea56-4465-994a-0494571603f0 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.763042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d96e4-ea56-4465-994a-0494571603f0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.763317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2d96e4-ea56-4465-994a-0494571603f0 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.764822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 72/140] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:14.771247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.771539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.771838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.802787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:14.804038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:14.804332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:14.804984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:14.805266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:14.805542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:14.806686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:14.808176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:14.809765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 69/141] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:14.821091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:14.928419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 73/142] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:14.959346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:14.987517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c0833-33f0-40b7-b2ce-b47181253317 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:15.023411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:15.023977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:15.024261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:15.024535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:15.025196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:15.026716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:15.050005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 70/143] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:14 2022] POST /identity/v3/users => generated 283 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:15.342964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:15.415874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:15.465694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d81981-432a-4598-a4ad-56a330a2cb8f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:15.501008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:15.501645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:15.501919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:15.502243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:15.512745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:15.518302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:15.519184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:15.520280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 74/144] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:15.525660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:15.644201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43af8de8-3983-462c-9c55-89d873ebd116 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:15.684077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:15.690920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:15.691811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:15.692384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:15.692759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:15.693650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:15.694186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:15.695851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:15.709618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 71/145] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:15 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:15.715855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:15.822387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08ab5f-3def-4b23-a57a-ab23aa0e8d70 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:15.850206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:15.857881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:15.858515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:15.858856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:15.859056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] PATH_INFO: `/v3/users/0aaf48fe968a417fa31da8c18fa3048b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:15.860690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] RBAC: Authorizing `identity:get_user(user_id=0aaf48fe968a417fa31da8c18fa3048b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:15.862502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:15.869048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 75/146] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:15 2022] GET /identity/v3/users/0aaf48fe968a417fa31da8c18fa3048b => generated 289 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:15.870403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:15.985711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e33c16-8e1a-4ed0-96eb-5d111f301c90 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:16.024369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:16.025055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:16.025333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:16.025602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:16.026804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:16.028338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75f0c47-10e6-4a48-b85f-551081e737bd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:16.030001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 72/147] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:15 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:16.036392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:16.152959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e05f3c4-14d0-4cbb-83da-590a2253773d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:16.188770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:16.189438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:16.189710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:16.189978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/users/0aaf48fe968a417fa31da8c18fa3048b/roles/c40662578aa541a1897ea45391239390` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:16.191930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, user_id=0aaf48fe968a417fa31da8c18fa3048b, role_id=c40662578aa541a1897ea45391239390)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:16.193540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e9889f-3598-48d7-8e80-96262b984267 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:16.212465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 76/148] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:16 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/users/0aaf48fe968a417fa31da8c18fa3048b/roles/c40662578aa541a1897ea45391239390 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:16.833567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109194-bfa5-43bd-9edb-ce9c11e6f4d5 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:16.833933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109194-bfa5-43bd-9edb-ce9c11e6f4d5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:16.834130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d109194-bfa5-43bd-9edb-ce9c11e6f4d5 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:16.835448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 73/149] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:16.841048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:16.841984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:16.842463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:16.864061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:16.865591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:16.930667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:16.955238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 77/150] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:17.539761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109194-bfa5-43bd-9edb-ce9c11e6f4d5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:17.616764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:17.668469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d109194-bfa5-43bd-9edb-ce9c11e6f4d5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:17.711716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:17.712456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:17.712745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:17.713014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:17.726623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:17.731882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:17.732818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:17.733662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 74/151] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:17.739990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:17.847457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939287c1-a3b3-49e1-b56f-c0fb8a7934fd None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:17.884932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:17.885551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:17.885829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:17.886100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:17.886780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:17.887077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:17.888568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409b5494-2be4-48f6-ba7c-8c75e6790a1b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:17.898473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 78/152] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:17.904253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:17.985448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6b2e-59ca-41d4-864c-448c8064f395 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:17.985746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6b2e-59ca-41d4-864c-448c8064f395 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:17.985914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d6b2e-59ca-41d4-864c-448c8064f395 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:17.987497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 79/153] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:17.988444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29ed1-f5b4-4285-84e1-49c1ec76eebf None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:17.988779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29ed1-f5b4-4285-84e1-49c1ec76eebf None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:17.989054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f29ed1-f5b4-4285-84e1-49c1ec76eebf None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:17.990244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 80/154] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:17.992790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54924d-5a82-4b39-95ba-d55763636ed6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:17.993068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54924d-5a82-4b39-95ba-d55763636ed6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:17.993418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa54924d-5a82-4b39-95ba-d55763636ed6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.012545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-aa54924d-5a82-4b39-95ba-d55763636ed6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:18.013756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-aa54924d-5a82-4b39-95ba-d55763636ed6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:18.051670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513650a3-e0cc-4de0-8aa3-b616641af9df None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:18.099517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:18.104021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:18.134039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:18.134678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.134952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.135220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] PATH_INFO: `/v3/users/f5af3cffbb0b41788f819ee8fb479d3a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.136821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] RBAC: Authorizing `identity:get_user(user_id=f5af3cffbb0b41788f819ee8fb479d3a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:18.138774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b504924d-4611-4733-b00a-54f7accba474 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:18.141475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 75/155] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:17 2022] GET /identity/v3/users/f5af3cffbb0b41788f819ee8fb479d3a => generated 247 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:18.146339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5cc9-4d9e-4abb-937e-f8629cdc8485 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.146846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5cc9-4d9e-4abb-937e-f8629cdc8485 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.147311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a5cc9-4d9e-4abb-937e-f8629cdc8485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.150218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 81/156] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:18.151713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f401d-3773-48dd-8842-f4143bb828d2 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.152223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f401d-3773-48dd-8842-f4143bb828d2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.157002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f401d-3773-48dd-8842-f4143bb828d2 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.158579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 82/157] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:18 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:18.159381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f401d-3773-48dd-8842-f4143bb828d2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:18.171289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d28a5cc9-4d9e-4abb-937e-f8629cdc8485 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:18.174052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d28a5cc9-4d9e-4abb-937e-f8629cdc8485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:18.299923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 76/158] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:18.301566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.303062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.303521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.344908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:18.346531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:18.373584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a81f401d-3773-48dd-8842-f4143bb828d2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:18.416023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:18.417756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.418229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.418709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.474049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 77/159] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:18.482162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:18.506501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:18.508334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:18.611070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 83/160] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 452 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:18.617161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:18.673717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:18.729277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9466cccc-752d-4365-9b1b-e0193ff584b8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:18.770776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:18.771814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.772280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.772731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.776190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:18.777903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:18.779791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 78/161] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:18 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:18.786101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:18.860780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:18.901782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:18.926497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33a0a7a-e146-46a9-8fca-7802c556c0d1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:18.977863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:18.978858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:18.979337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:18.979836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:18.980761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=f5af3cffbb0b41788f819ee8fb479d3a) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:18.981274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:18.982974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:18.996010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 84/162] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:18 2022] GET /identity/v3/role_assignments?user.id=f5af3cffbb0b41788f819ee8fb479d3a&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:18.997207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.049373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa29efd-0b1a-477a-a052-56ea1795360a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.083703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:19.119288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.120345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.120818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.121298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.141387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:19.146789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:19.147704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:19.148543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:19.157076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 79/163] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:19.162992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.211144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ca2ce7-c0ba-4fde-a52e-6b56a12bf309 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.277817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.278467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.278742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.279011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.302234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:19.307718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:19.308707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:19.309490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:19.314182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 85/164] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:18 2022] GET /identity/v3/roles/member => generated 84 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:19.315115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.318617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:19.444634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ac707e-7363-4c9d-8c0f-aa5293acddc0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.499230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f56240e7-be5d-42d4-9402-1dec9efdcc50 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.534184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.535218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.535746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.536162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.536449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.536776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.537053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.537324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.537990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:19.538290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:19.539660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:19.549532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:19.555792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:19.556668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:19.557469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:19.558992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 80/165] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 396 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:19.560031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.560950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 86/166] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:19.567118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.643360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:19.680293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:19.752417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b36327-dbcd-43e1-90c9-92a859c38fce None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.772939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae7533e-0881-4e5a-b915-f7f75e0d8be1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.815393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.816521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.816995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.817457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.819943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:19.821694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:19.824259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 87/167] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:19.826220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.850146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:19.851233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.852134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.852426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.853094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:19.853396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:19.854946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328f1b62-34e3-4900-911d-f0604baff792 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:19.865914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 81/168] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:19.871567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b073b7-2858-4e91-8040-6b7122bfdf09 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:19.871567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b073b7-2858-4e91-8040-6b7122bfdf09 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:19.871567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b073b7-2858-4e91-8040-6b7122bfdf09 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:19.871567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 82/169] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:19.871567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b073b7-2858-4e91-8040-6b7122bfdf09 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:19.983299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:19.988531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b073b7-2858-4e91-8040-6b7122bfdf09 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:19.990475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981a69b6-878d-4306-aef3-0f9cac8b9c58 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.026503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.027036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.027313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.027585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.045256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.056517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.057233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.057518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.057787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.058449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:20.058743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.060343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f44663-1709-431f-aa8b-816906256fa4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.080899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 88/170] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:20.082400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.082684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.083011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.106545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.108040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.120851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:20.122164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:20.220131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.224631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 83/171] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:20.225671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.266212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 89/172] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:20.267082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.332582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89205f87-a589-40e1-8b9e-32a5c0742aa3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.371723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.372515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.372796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.373071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.374223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.376330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.382498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 84/173] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:20.382498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.450549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae52b57-631d-439b-88e3-368c1f9d0353 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.484167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.491753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.493596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30027470-d09d-43f7-a46d-bd140e50a2fe None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.521071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.522099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.522591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.523058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] PATH_INFO: `/v3/users/34bfe61c82534b93a479bdd6b667ca12` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.524578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] RBAC: Authorizing `identity:get_user(user_id=34bfe61c82534b93a479bdd6b667ca12)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.526283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.528097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 90/174] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/users/34bfe61c82534b93a479bdd6b667ca12 => generated 275 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:20.529122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.532400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.533049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.533327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.533596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.534743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.536387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.540159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 85/175] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:20.540159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.648310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cc0b32-61dc-48b7-9e3f-e2d482db06ba None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.678838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560ca639-df23-4b7d-b0fb-e5a5958ab531 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:20.684586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.685205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.685481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.685756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.695697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.716269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:20.716960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.717237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.717505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.762875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.764876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.778659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.791159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:20.792650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587f5307-3e0a-465f-af5c-1124136aad65 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:20.882250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 86/176] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:20.882250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.904524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 91/177] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:20.905877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ca62d-3a57-44e8-8622-d962d027a4a1 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.906248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ca62d-3a57-44e8-8622-d962d027a4a1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.906690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14ca62d-3a57-44e8-8622-d962d027a4a1 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.907965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 92/178] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:20.909193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320f8a-3d47-48ee-b5f8-3f54c21ca8d3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:20.909683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320f8a-3d47-48ee-b5f8-3f54c21ca8d3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:20.909956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e320f8a-3d47-48ee-b5f8-3f54c21ca8d3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:20.911274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 93/179] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:20.911868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320f8a-3d47-48ee-b5f8-3f54c21ca8d3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:20.924829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:20.990369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af07a02-75fe-4969-88bc-76f1ece4abbf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.004541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.016609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e320f8a-3d47-48ee-b5f8-3f54c21ca8d3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.029251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.030290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.030790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.031915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.032837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:21.033146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.034608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.040479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 87/180] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=791fea6050e741c0824356b63aa26aea => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.041277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.060415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.061333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.061759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.062178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.076127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:21.082289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:21.083428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 94/181] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:21.084296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.168762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.173044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a162ab62-ad7c-4fa1-b668-90ffdc9f3151 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.209461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f81051-9ce3-4641-bbd9-caf249c0dd8a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.213501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.214151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.215012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.215012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.215927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.217832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7bce5-0832-4864-b75b-cb5c3b8aaa6a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.220604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 88/182] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.222279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe452f1-f389-4d7a-9a28-a2e17355f290 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.222713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe452f1-f389-4d7a-9a28-a2e17355f290 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.223120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe452f1-f389-4d7a-9a28-a2e17355f290 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.243619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bfe452f1-f389-4d7a-9a28-a2e17355f290 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:21.245095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bfe452f1-f389-4d7a-9a28-a2e17355f290 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:21.246050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.246686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.246963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.247232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] PATH_INFO: `/v3/projects/d6886e13c71946c694a7855f317ca6ea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.248390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] RBAC: Authorizing `identity:get_project(project_id=d6886e13c71946c694a7855f317ca6ea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.249833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b752e3-9203-4029-be52-fe4276fcac1a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.252363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 95/183] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/projects/d6886e13c71946c694a7855f317ca6ea => generated 312 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.253505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.253789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.254064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.272563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:21.273783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:21.288919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.324042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 89/184] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:21.325443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca1c5-0bac-4c6b-9e10-704405984a31 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.325730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca1c5-0bac-4c6b-9e10-704405984a31 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.325998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cca1c5-0bac-4c6b-9e10-704405984a31 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.327229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 90/185] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:21.327944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cca1c5-0bac-4c6b-9e10-704405984a31 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.357813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 96/186] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:21.364009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.462508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.472044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cca1c5-0bac-4c6b-9e10-704405984a31 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.480209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c009b2-518d-4db0-98d5-8d40d12a3b57 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.516738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.517342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.517619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.517887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.518611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:21.518972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.520530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.520800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.521588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.522065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.522784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.524088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:21.524397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.525791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8687930-5d73-4b96-956a-378fb5f69b81 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.529839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 97/187] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=7da111f273124548ab0a4deafd90a54f => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.530626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.537919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 91/188] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.545376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.545987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.546463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.566165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.572534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:21.574350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:21.661782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 92/189] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:21.663483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.716153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd24f331-db00-401e-9cdd-e1034a410120 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.757549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.758424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.758852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.759259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.760166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=d6886e13c71946c694a7855f317ca6ea, user.id=34bfe61c82534b93a479bdd6b667ca12) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:21.760632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.762210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.768295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 98/190] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/role_assignments?user.id=34bfe61c82534b93a479bdd6b667ca12&scope.project.id=d6886e13c71946c694a7855f317ca6ea&role.id=791fea6050e741c0824356b63aa26aea => generated 608 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.769254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.792678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.807042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3415e76-f017-4f70-89e4-6d367d535e5d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.855138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.856084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.856532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.856948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.872993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:21.875000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:21.877388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 93/191] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:21.882871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:21.885226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:21.921507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4049b7d0-6ada-464e-9266-ee59b43b4f1a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:21.966439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:21.967007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:21.967281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:21.967547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:21.981578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:21.987004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:21.987924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:21.988755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 99/192] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:21.989419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.014004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bb7239-5d7b-49e8-a68e-17039f309a58 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.051592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.052409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.052612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.052890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.063506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:22.068531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:22.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:22.070410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 94/193] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:22.071212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.082832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.108096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439fc65d-4956-4ac3-9a53-9a1e914cad72 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.143064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.143665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.143968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.144240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.148186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.173695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b365edaa-065c-41e4-b09c-0fd20a23acb2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.208367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.208992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.209276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.209703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.210808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.212307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.212491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.213851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 95/194] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.213939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.214613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.288635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.310386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31312cc5-9588-4e52-9d9d-e61464e9e75a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.314369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 100/195] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:22.315208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.345424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.346034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.346310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.346586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.347253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] RBAC: Adding query filter params (name=reader) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:22.347543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.348949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.353014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.357403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 96/196] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.357403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.419143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a645c02-1ab2-401b-8ceb-8662929cb6e5 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.455272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.455908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.456184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.456452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.456778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1b4eb4-15e7-4d2a-9efd-8392152cdcec None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.457115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:22.457413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.458800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.466586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 101/197] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.467370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.493562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.494170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.494468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.494723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.495368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.496840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.506586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.520379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 97/198] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:22 2022] POST /identity/v3/users => generated 297 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:22.521237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.570121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.576402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce33bc3d-d654-4a0c-b095-121f94846813 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.619396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.620179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.620455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.620728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.621924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.623461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.625782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 102/199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.626579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.655406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a57e2772-3777-4225-a767-263522a91dbf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.697239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.697239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.697938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.697938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] PATH_INFO: `/v3/users/0aaf48fe968a417fa31da8c18fa3048b` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.699887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] RBAC: Authorizing `identity:get_user(user_id=0aaf48fe968a417fa31da8c18fa3048b)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.702801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.702921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 98/200] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/users/0aaf48fe968a417fa31da8c18fa3048b => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.703646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.752782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b55780-500e-4364-8e7a-e2862ca6012a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.776388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.799699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.800536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.800763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.801039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.802338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.803878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.806544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 103/201] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.807265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.831158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0591cb83-6c0b-4c3f-bf6a-c136131d9c67 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.854210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:22.882338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.883266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.883563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.883880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:22.884627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=1105418b1c5f4e6880a849e9c5964f74) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:22.884940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:22.886917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:22.895168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 99/202] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/role_assignments?user.id=1105418b1c5f4e6880a849e9c5964f74&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:22.895858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:22.940174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcadbf87-dc33-4e0c-9a7a-3b2d006cbe6f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:22.996199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:22.996857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:22.997145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:22.997390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.066077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b6b6b4-306b-4633-b89e-4ec66e87ed4f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:23.121672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:23.125393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.127562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.138463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:23.144095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:23.144617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:23.145367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.196846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:23.258357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.259845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.302117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 104/203] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:23.308045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:23.414094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 100/204] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:23.420177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:23.453415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:23.511557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbbdea4-2b2c-4153-86cb-b0cb69bd1d69 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:23.529839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849295d5-2e17-4911-abba-8fa12c06ae13 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:23.569910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:23.570550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:23.570821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:23.571084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.573442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.574881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.577532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 101/205] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:23 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:23.584145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:23.597323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:23.597973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:23.598250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:23.598522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.604405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.605876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.607539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 105/206] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:23 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:23.613955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:23.632033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:23.685775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:23.693269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b24acfe-a7ff-4aeb-8803-11e70f935bf6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:23.732218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:23.732872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:23.733079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:23.733343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.734060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=1105418b1c5f4e6880a849e9c5964f74) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:23.734420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.736397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c024ec2-d825-45bf-9987-a62d44552dd8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.742366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 102/207] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:23 2022] GET /identity/v3/role_assignments?user.id=1105418b1c5f4e6880a849e9c5964f74&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=7da111f273124548ab0a4deafd90a54f => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:23.807143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4746e1-85f8-4763-bbe1-af7288800641 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:23.843301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:23.843978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:23.844254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:23.844523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:23.845249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, scope.project.id=8c959789b1364446916fb2b71eb40efe, user.id=0aaf48fe968a417fa31da8c18fa3048b) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:23.845618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:23.847078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c9e4dc-6d40-4fbe-aea0-90b0ca2cc426 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:23.853369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 106/208] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:23 2022] GET /identity/v3/role_assignments?user.id=0aaf48fe968a417fa31da8c18fa3048b&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=c40662578aa541a1897ea45391239390 => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:25.046042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827dea-84e7-430b-826e-ceb24e94c174 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.046589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827dea-84e7-430b-826e-ceb24e94c174 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.046589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5827dea-84e7-430b-826e-ceb24e94c174 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.047985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 103/209] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:25.053187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647693d-b1ba-4379-b684-c29a195b8073 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.053588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647693d-b1ba-4379-b684-c29a195b8073 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.053783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647693d-b1ba-4379-b684-c29a195b8073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.072438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c647693d-b1ba-4379-b684-c29a195b8073 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:25.073688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c647693d-b1ba-4379-b684-c29a195b8073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:25.134918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:25.144740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a6a38-c383-45ad-8074-51fa31ef6416 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.145272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a6a38-c383-45ad-8074-51fa31ef6416 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.145539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864a6a38-c383-45ad-8074-51fa31ef6416 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.146273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 107/210] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:25.147127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 104/211] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:25.152333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e043-b7c3-445b-839a-b464fc1e5bee None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.152824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e043-b7c3-445b-839a-b464fc1e5bee None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.153315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee51e043-b7c3-445b-839a-b464fc1e5bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.171807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-ee51e043-b7c3-445b-839a-b464fc1e5bee None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:25.173840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ee51e043-b7c3-445b-839a-b464fc1e5bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:25.247237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 108/212] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:25.328131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5acf-ff10-48b1-b2a8-18af817f4f16 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.328315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5acf-ff10-48b1-b2a8-18af817f4f16 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.328582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df5acf-ff10-48b1-b2a8-18af817f4f16 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.330009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 105/213] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:25.335147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.335511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.335704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.357068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:25.358522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:25.427178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5acf-ff10-48b1-b2a8-18af817f4f16 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.427681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 109/214] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:25.546323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df5acf-ff10-48b1-b2a8-18af817f4f16 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:25.555595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.592641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:25.593843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.594311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.594751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.607436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:25.614758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:25.615646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:25.616466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:25.619236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 106/215] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:25.623856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:25.624883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.645851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:25.674885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b57253-87cf-442e-992f-8982382c8955 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:25.714335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:25.714967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.715239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.715503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.716618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:25.718049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:25.719710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 110/216] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:25.720452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.740133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702bd257-9995-48e8-b74d-5a33f473d423 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:25.776172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:25.776781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.777047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.777311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.778070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:25.778370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:25.779860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:25.788986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 107/217] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:25.794195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.824393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ef3432-1e05-450b-9684-4be119dbb3a7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:25.849616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:25.861606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:25.862230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.862504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.862773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.873417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:25.878457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:25.879352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:25.880212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 111/218] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:25.881337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.902146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:25.924948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a05e30d-2faf-4b94-ae0b-2254aa447bb9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:25.960818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:25.961419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:25.961794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:25.961964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:25.962598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:25.964052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:25.985540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 108/219] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:25 2022] POST /identity/v3/users => generated 297 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:25.993393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:25.996086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ff6689-b867-4cda-b1ab-058ece025292 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.041753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.042423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.042708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.043333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] PATH_INFO: `/v3/users/6023d5d71c79491391c4eb6635021b17` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.063419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] RBAC: Authorizing `identity:get_user(user_id=6023d5d71c79491391c4eb6635021b17)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.065433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.072089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 112/220] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/users/6023d5d71c79491391c4eb6635021b17 => generated 297 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:26.074718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.132929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.134616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09144358-db1b-48b2-b7bc-5df8088a3de5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.178429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.179047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.179323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.179596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.180287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:26.180585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.181960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b01ab0e-580e-43fa-94ff-ba650fec1f83 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.184341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.192932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 109/221] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:26.194186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571c9c-7a6f-4c6d-b50f-312ffaa2875e None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.194496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571c9c-7a6f-4c6d-b50f-312ffaa2875e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.195022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93571c9c-7a6f-4c6d-b50f-312ffaa2875e None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.197412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 110/222] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:26.202113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93571c9c-7a6f-4c6d-b50f-312ffaa2875e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.210258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dd6b641-e59d-47ac-bfc2-dd17a492cf2c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.247518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.248143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.248428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.248697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.324060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93571c9c-7a6f-4c6d-b50f-312ffaa2875e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.330740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.332359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.369316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.370066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.370346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.370618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.371900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.373481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2329bd32-72bf-4709-aaff-94edac1d29c2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.375413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 111/223] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:26.376588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.376910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.377231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.377895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.398676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:26.400551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:26.450606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 113/224] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:26.451969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.472419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.488027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 112/225] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:26.489467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.569527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a3de39-e025-4086-b75e-6a56be6e12cc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.610419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.611439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.611981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.612454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.613878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.615628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.618197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 114/226] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:26.624288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.646580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.661209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2cbe62f-e625-471d-9fee-12bdff2c5d5a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.700452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.701451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.701932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.702427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.703820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.706722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.709201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 113/227] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:26.716664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.794665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1759cf0-a11e-4d09-8eed-7ad7b5572645 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.800142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:26.849352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988b72e9-8e06-455b-9b6e-9a073f0ce361 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:26.868785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.869855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.870360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.870833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/1105418b1c5f4e6880a849e9c5964f74/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.873021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, user_id=1105418b1c5f4e6880a849e9c5964f74, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.874678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.894804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 115/228] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:26 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/1105418b1c5f4e6880a849e9c5964f74/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:26.900814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:26.904278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:26.905333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:26.905904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:26.906704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:26.907827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=6023d5d71c79491391c4eb6635021b17) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:26.908400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:26.911184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:26.919059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 114/229] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/role_assignments?user.id=6023d5d71c79491391c4eb6635021b17&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=791fea6050e741c0824356b63aa26aea => generated 259 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:27.063525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:27.107804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cee2cbb-d72f-4a11-816d-d96aafabd33f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:27.152173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:27.152886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:27.153167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:27.153449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:27.165520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:27.170724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:27.171643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:27.172519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 116/230] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:27.178093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:27.289578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151ce8a6-6c5f-499f-b498-7767808ad15a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:27.317559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:27.326008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:27.326731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:27.327012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:27.327351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:27.328837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:27.329336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:27.330919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:27.340056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 115/231] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:27.346143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:27.462182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-332d8390-4007-47c0-a3dd-b0010beb06e6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:27.492187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:27.497921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:27.498567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:27.498849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:27.499114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:27.500525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:27.502376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:27.507885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 117/232] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:27 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:27.509793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:27.620244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8844a61e-74de-4db5-8a8e-3cce5b2efd9e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:27.656981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:27.657665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:27.657949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:27.658223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:27.659356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:27.660837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419da8d9-c2b2-4e39-9935-e1d8064c8f57 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:27.662820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 116/233] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:27 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:27.668533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:27.791203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80458d33-8764-4f16-8f71-5e4f712aae6a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:27.831808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:27.832477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:27.832751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:27.833022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/1105418b1c5f4e6880a849e9c5964f74/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:27.840465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, user_id=1105418b1c5f4e6880a849e9c5964f74, role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:27.841911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bec2bf-8737-41a0-b976-f9af60f13514 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:27.866542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 118/234] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:27 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/1105418b1c5f4e6880a849e9c5964f74/roles/7da111f273124548ab0a4deafd90a54f => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:28.763128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209ba1-3827-44c2-8af9-e7be9b4dbc99 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:28.763640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209ba1-3827-44c2-8af9-e7be9b4dbc99 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:28.763712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d209ba1-3827-44c2-8af9-e7be9b4dbc99 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:28.765045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 117/235] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:28.770670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf66b-f36a-48ac-a729-b072a52d4b3f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:28.771080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf66b-f36a-48ac-a729-b072a52d4b3f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:28.771246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8eaf66b-f36a-48ac-a729-b072a52d4b3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:28.794991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b8eaf66b-f36a-48ac-a729-b072a52d4b3f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:28.796216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b8eaf66b-f36a-48ac-a729-b072a52d4b3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:28.862440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:28.880511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 119/236] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:28.889507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa0a-2569-45c8-914a-2f70c9969b2d None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:28.889790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa0a-2569-45c8-914a-2f70c9969b2d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:28.890062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6fa0a-2569-45c8-914a-2f70c9969b2d None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:28.891626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 118/237] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:28.896988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:28.897276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:28.897555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:28.916232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:28.917422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:29.010240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 120/238] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:29.187342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fa0a-2569-45c8-914a-2f70c9969b2d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:29.276858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:29.336401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6fa0a-2569-45c8-914a-2f70c9969b2d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:29.380374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:29.381309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.381815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.382290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.400581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:29.405760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:29.407245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:29.408074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:29.410618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 119/239] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:29.416529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:29.559076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaf77d3-9a43-4d92-8231-7f02f7f4ea81 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:29.592333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:29.596835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:29.609718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:29.610612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.611064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.611513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.612541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:29.613079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:29.614605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:29.624228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 121/240] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:29.632258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:29.749042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f6b17e-5039-4967-a819-b39ae2798b69 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:29.765809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:29.772012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d126bb-f665-4d4b-b959-f12f1d33b7d8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:29.783980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:29.784603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.784879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.785141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.786228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:29.787660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b7917f-5ad3-43ec-a0ef-db1a340eff28 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 120/241] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e809e2-31e2-494f-a3d0-b1f67c7529b8 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e809e2-31e2-494f-a3d0-b1f67c7529b8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e809e2-31e2-494f-a3d0-b1f67c7529b8 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 121/242] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b163-f8b6-4b49-8ed9-3269298b939e None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.795116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b163-f8b6-4b49-8ed9-3269298b939e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.795669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa4b163-f8b6-4b49-8ed9-3269298b939e None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.795669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 122/243] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:29.800276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4b163-f8b6-4b49-8ed9-3269298b939e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:29.817570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:29.818198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.818496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.818842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] PATH_INFO: `/v3/users/c1627706f08c477184fd972faeab1183` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.833594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] RBAC: Authorizing `identity:get_user(user_id=c1627706f08c477184fd972faeab1183)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:29.835145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e99ebc1-5f5b-403a-a31a-4fa859d0cfce None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:29.841369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 122/244] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:29 2022] GET /identity/v3/users/c1627706f08c477184fd972faeab1183 => generated 297 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:29.841369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea06b-2cea-429e-8566-843a95f66c14 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.841369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea06b-2cea-429e-8566-843a95f66c14 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.841369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ea06b-2cea-429e-8566-843a95f66c14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.857946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-727ea06b-2cea-429e-8566-843a95f66c14 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:29.859336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-727ea06b-2cea-429e-8566-843a95f66c14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:29.891191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:29.904562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa4b163-f8b6-4b49-8ed9-3269298b939e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:29.932865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 123/245] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:29.934321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.934607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.934878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.954342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:29.955523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:29.955923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:29.956803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:29.957524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:29.958051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:29.959873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:29.961498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:29.992872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 123/246] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:29 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:29.995414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.032498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 124/247] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:30.046353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.113869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cbca08-8aff-4f8e-8059-543ec5f02459 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.150460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.151386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.151859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.152422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.226811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:30.228639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:30.273279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.337811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.342919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 124/248] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:30.348128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.460912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.464864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc66f919-480c-4ee1-b335-773d15f53745 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.476131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d993694-0950-4273-8fdc-c395540825cf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.511482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.511482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.511482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.511892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.527040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.527978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.528229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:30.528539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.528944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:30.534219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:30.535330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:30.536400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 125/249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:30.537064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.544347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:30.550331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:30.551401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:30.552558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:30.554820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 125/250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:30.555772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.560213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.664790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f52fbc-ebf7-41b4-a866-ab1f3eb16a3e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.684389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e430e9-fe09-471d-b8bd-e9b1b98cc58b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.705334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.706339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.706815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.707283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.708676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:30.710322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:30.712668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 126/251] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:30.713712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.732245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.733209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.733683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.734147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.735700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:30.736274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:30.737970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38169f5f-1a60-4e13-b208-c3bc8f72d474 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:30.746891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 126/252] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:30.748543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e9a7-86d1-4baa-bd54-a46f72810c00 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.748856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.749274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e9a7-86d1-4baa-bd54-a46f72810c00 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.749742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b09e9a7-86d1-4baa-bd54-a46f72810c00 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.751816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 127/253] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:30.752971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e9a7-86d1-4baa-bd54-a46f72810c00 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.829182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473460d7-9106-46d2-a71e-fc40d855fd70 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.832936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:30.871542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.872534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.873233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.874022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.875777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] RBAC: Adding query filter params (name=member) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:30.876282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:30.877884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:30.878016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b09e9a7-86d1-4baa-bd54-a46f72810c00 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:30.890774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 127/254] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:30.892141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:30.916556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:30.917553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.918008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.918468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.919416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=c1627706f08c477184fd972faeab1183) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:30.919942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:30.921578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4678ce27-da9d-40ca-b39e-e54c6c9014f3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:30.927965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 128/255] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/role_assignments?user.id=c1627706f08c477184fd972faeab1183&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=c40662578aa541a1897ea45391239390 => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:30.929424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:30.929885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:30.930376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:30.951095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:30.952940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:31.013640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.041088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80002b46-977a-4434-b4b6-30b7d6ac7c06 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.082760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 129/256] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:31.083651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.118549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.119698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.120244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.120713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.123782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:31.123782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:31.131103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 128/257] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:30 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:31.140843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.155904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.227761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cafd86-aa49-4547-9b5c-0f62f4984bfe None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.265683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.267185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.267663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.268157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] PATH_INFO: `/v3/users/6023d5d71c79491391c4eb6635021b17` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.269514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] RBAC: Authorizing `identity:get_user(user_id=6023d5d71c79491391c4eb6635021b17)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:31.271560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:31.273362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 130/258] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/users/6023d5d71c79491391c4eb6635021b17 => generated 297 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:31.279215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.285945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44da2234-6afd-4f01-a681-464bc5208f30 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.363571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.364214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.364490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.364770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.392207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1688def0-06f8-4103-95c7-cf2fdef39d32 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.428093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.437627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.438265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.439302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.439844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.440324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.442334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:31.444646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:31.446535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 131/259] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:31.452892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.538000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:31.539955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:31.650023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 129/260] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:31.651329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.724322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.726468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0cd3af-3508-4ebc-89e7-dd8f7f65d182 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.763126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61af5da1-d3d9-4923-8730-6f4c0b49538c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.803367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.804226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.804621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.804995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.820602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:31.826924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:31.828967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:31.831369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 130/261] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:31.833925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.879499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.880287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.880479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.880754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/6023d5d71c79491391c4eb6635021b17/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:31.892681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, user_id=6023d5d71c79491391c4eb6635021b17, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:31.894888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:31.946998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 132/262] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:31 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/6023d5d71c79491391c4eb6635021b17/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:38:31.947635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:31.954368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30253beb-0717-4f8a-82b4-0b0a6a87b01b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:31.984150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:31.997845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:31.998507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:31.998869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:31.999155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:32.000394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:32.002235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:32.004419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 131/263] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:32.014185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:32.093560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:32.195842 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696b78e6-8657-4965-8735-e5e372e10290 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:32.211550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cf5914-32a7-4c3a-b9d1-903b74756b69 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:32.234798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:32.235420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:32.235694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:32.235991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:32.236658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:32.237490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:32.239030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:32.248941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 133/264] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:31 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:32.255966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:32.282984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:32.283610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:32.284016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:32.284292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:32.285026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=1105418b1c5f4e6880a849e9c5964f74) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:32.285538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:32.288475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:32.302165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 132/265] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:32 2022] GET /identity/v3/role_assignments?user.id=1105418b1c5f4e6880a849e9c5964f74&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:32.372390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06ad28-3f4b-4773-af7b-772a021a9e3c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:32.390190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:32.410613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:32.411266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:32.411547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:32.411850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] PATH_INFO: `/v3/users/1105418b1c5f4e6880a849e9c5964f74` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:32.413025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] RBAC: Authorizing `identity:get_user(user_id=1105418b1c5f4e6880a849e9c5964f74)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:32.414658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:32.416815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 134/266] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:32 2022] GET /identity/v3/users/1105418b1c5f4e6880a849e9c5964f74 => generated 283 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:32.422921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:32.507144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:32.589124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1603ed-5d7b-485d-9647-e01ab728901b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:32.641908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:32.642453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:32.642734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:32.643008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:32.733541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:32.735577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:32.798115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:32.860862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 133/267] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:32.866263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:32.985119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450ee2b9-76eb-4ebe-91ae-3d29fa4da68d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:33.020028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:33.020925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.021208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.021485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.022628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:33.024100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b0d2b4-2715-4c8e-975a-c393ae636e5e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:33.025738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 135/268] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:32 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:33.032253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:33.167761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ff52ee-1a6b-45cd-b28b-8d071426ce1b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:33.212733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:33.213351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.213976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.214256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.214996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=1105418b1c5f4e6880a849e9c5964f74) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:33.215305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:33.216860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478a23ef-dcb8-47cc-8a43-f85be6253a63 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:33.224043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 134/269] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:33 2022] GET /identity/v3/role_assignments?user.id=1105418b1c5f4e6880a849e9c5964f74&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=7da111f273124548ab0a4deafd90a54f => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:33.353011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9deb-1975-40c9-9d04-4f9d9ebbee6a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.353301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9deb-1975-40c9-9d04-4f9d9ebbee6a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.353469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270b9deb-1975-40c9-9d04-4f9d9ebbee6a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.355058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 136/270] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:33.368600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a82f5-ca88-413a-9613-6f92266d522d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.369232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a82f5-ca88-413a-9613-6f92266d522d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.369713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81a82f5-ca88-413a-9613-6f92266d522d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.397015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a81a82f5-ca88-413a-9613-6f92266d522d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:33.398665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a81a82f5-ca88-413a-9613-6f92266d522d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:33.408137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:33.507402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 135/271] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:33.531248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eadaa-1876-451d-9b18-aa21c045857e None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.531559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eadaa-1876-451d-9b18-aa21c045857e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.531836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9eadaa-1876-451d-9b18-aa21c045857e None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.533382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 137/272] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:33.538734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.539018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.539290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.557505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:33.558680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:33.629034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 136/273] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:33.805824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9eadaa-1876-451d-9b18-aa21c045857e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:33.863992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:33.919072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9eadaa-1876-451d-9b18-aa21c045857e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:33.926502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:33.966786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:33.967546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:33.967867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:33.968264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:33.969934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:33.971527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:33.974212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 138/274] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:33.979586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.013316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.046190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7212e5-8948-46ea-a717-8c5e961760e2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.084041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.084680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.084963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.085234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.092428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d817acaf-1bba-4ba2-800a-37c481f15c36 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.096705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-8a85eeed-3caa-4323-bf54-92064eb80cbd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:34.101564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:34.102466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:34.103358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 137/275] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:34.104498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011fe5-21cf-46ea-84db-79b9a00185ee None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.104498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011fe5-21cf-46ea-84db-79b9a00185ee None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.104498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011fe5-21cf-46ea-84db-79b9a00185ee None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.106276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 138/276] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:34.110872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011fe5-21cf-46ea-84db-79b9a00185ee None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.117457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.132891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.133503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.133788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.134060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.134718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:34.136203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074707fb-e035-4283-9dab-35b73d126493 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:34.163268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 139/277] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:38:33 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:34.164528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.164812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.165086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.187205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:34.189855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:34.239232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011fe5-21cf-46ea-84db-79b9a00185ee None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.285818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.293569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.294221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.294778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.295059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.296271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:34.296581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:34.298666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:34.304999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 140/278] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:34.312419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 139/279] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:34.319142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.430717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fd1158e-8e1c-4ea2-9f82-de77c7d22b3c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.437877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.471978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.472631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.472898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.473168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] PATH_INFO: `/v3/users/8c4f92bb239244d5a409efe29b4c3589` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.487859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] RBAC: Authorizing `identity:get_user(user_id=8c4f92bb239244d5a409efe29b4c3589)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:34.489386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:34.491426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 141/280] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:34 2022] GET /identity/v3/users/8c4f92bb239244d5a409efe29b4c3589 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:34.497622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.600426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.614336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad431ff-bd91-4fb7-b689-6dbf893b58c6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.655317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.655964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.656273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.657083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.657821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, user.id=8c4f92bb239244d5a409efe29b4c3589, scope.system=all) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:34.658309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:34.659766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-515d2b60-53d9-4eae-aa0c-8b6b3c6543e3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:34.667167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 140/281] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 20 04:38:34 2022] GET /identity/v3/role_assignments?user.id=8c4f92bb239244d5a409efe29b4c3589&scope.system=all&role.id=791fea6050e741c0824356b63aa26aea => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:34.723622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9474328-221b-4132-af46-3472041f274f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.724002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9474328-221b-4132-af46-3472041f274f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.724212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9474328-221b-4132-af46-3472041f274f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.725744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 141/282] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:34.731428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.731709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.732025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.737817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312b2c9e-0248-4d2d-bf68-d8d82ba6789e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:34.753497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:34.754762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:34.814447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:34.815096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:34.815434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:34.815713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:34.837299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.837491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:34.843823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:34.844793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:34.845652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:34.847971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 142/283] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:34.854800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:34.873681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 142/284] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:34.893904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:34.975998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904d2237-08ad-422e-88f3-9d766a5dd1c0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.011361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.012055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.012342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.012616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.013287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] RBAC: Adding query filter params (name=reader) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:35.013591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.014973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.025014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 143/285] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:35.030768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.171477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd67ae-5667-4ec4-8d16-a3e1cb583e79 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.220212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.221996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.222654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.222932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.223209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] PATH_INFO: `/v3/users/c1627706f08c477184fd972faeab1183` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.224382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] RBAC: Authorizing `identity:get_user(user_id=c1627706f08c477184fd972faeab1183)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.225842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.227820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 143/286] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/users/c1627706f08c477184fd972faeab1183 => generated 297 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:35.233741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.322482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:35.357890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:35.374324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f268fc00-b4a7-4add-9eb6-27d6eda1a2ac None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.411528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.412201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.412580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.412867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.424465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:35.430081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:35.430968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:35.436588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 144/287] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:35.437885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.449742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2a762-d649-41c3-862a-3b2bfca349a3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.533135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.533691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.533966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.534235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.535901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.540035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.541923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 144/288] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:35.548222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.606284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01b83b-7960-48ca-a09e-6aff6eb43aca None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.664887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.665504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.665781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.666049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.666709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:35.671151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.673674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.700740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 145/289] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:35.703365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:35.726976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:35.749548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb510a5c-35a8-4a0a-b524-1a1bd0a752a8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.774677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:35.787392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.788368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.788869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.789339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/c1627706f08c477184fd972faeab1183/roles/c40662578aa541a1897ea45391239390` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.791617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, user_id=c1627706f08c477184fd972faeab1183, role_id=c40662578aa541a1897ea45391239390)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.793306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.811773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 145/290] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:38:35 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/users/c1627706f08c477184fd972faeab1183/roles/c40662578aa541a1897ea45391239390 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:35.897037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe222598-75d8-4151-b9be-e2c73467ee16 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:35.945949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:35.946993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:35.947471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:35.948021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] PATH_INFO: `/v3/users/6023d5d71c79491391c4eb6635021b17` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:35.949401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] RBAC: Authorizing `identity:get_user(user_id=6023d5d71c79491391c4eb6635021b17)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:35.951119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:35.953042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 146/291] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/users/6023d5d71c79491391c4eb6635021b17 => generated 297 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:35.959366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:36.082658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347646da-eac3-4cd5-b853-850f23eebb82 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:36.118221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:36.119227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:36.119701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:36.120196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:36.193903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:36.224899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:36.226706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:36.351492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 146/292] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:36.356718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:36.448552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:36.468272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8121a33b-b547-4000-8d54-4246d55a66ad None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:36.503470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:36.504127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:36.504408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:36.504685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:36.505842 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:36.507276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42c6dad-aa8f-47a0-8a1d-60e0bb89adf9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:36.509113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 147/293] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:36 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:36.514859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:36.632194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:36.652418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0df696-4aa5-4359-b89c-5e9134ae1f7a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:36.700712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:36.701663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:36.702132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:36.702636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:36.704153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=6023d5d71c79491391c4eb6635021b17) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:36.704654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:36.706264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d22fcf6-090e-4f75-8058-83e54092c98a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:36.716234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 147/294] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:36 2022] GET /identity/v3/role_assignments?user.id=6023d5d71c79491391c4eb6635021b17&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=791fea6050e741c0824356b63aa26aea => generated 608 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:37.173683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d0db-97fb-439b-a0a9-c48a54470795 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.173962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d0db-97fb-439b-a0a9-c48a54470795 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.174508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a9d0db-97fb-439b-a0a9-c48a54470795 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.176506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 148/295] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:37.183091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ae2e-1408-462d-ba1c-4319d9027e51 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.184196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ae2e-1408-462d-ba1c-4319d9027e51 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.184718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634ae2e-1408-462d-ba1c-4319d9027e51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.204806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6634ae2e-1408-462d-ba1c-4319d9027e51 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:37.206341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6634ae2e-1408-462d-ba1c-4319d9027e51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:37.292575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 148/296] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:37.303056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822663e-5c27-4a43-bf8a-9ead3054e72c None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.303643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822663e-5c27-4a43-bf8a-9ead3054e72c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.304134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9822663e-5c27-4a43-bf8a-9ead3054e72c None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.305607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 149/297] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:37.310997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.311283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.311558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.315115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9f07-c82e-43e6-a580-2cfffb472aa7 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.315634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9f07-c82e-43e6-a580-2cfffb472aa7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.316129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e9f07-c82e-43e6-a580-2cfffb472aa7 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.317836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 150/298] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:37.325495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.326044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.326518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.332460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:37.333655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:37.348243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:37.349866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:37.412189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 149/299] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:37.429354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 151/300] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:37.583900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:37.594538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:37.687208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245ec15c-feb9-42f9-93b6-a7c83d9e2815 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:37.696439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:37.723381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:37.724046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.724324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.724597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.736245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:37.741302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:37.742191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 150/301] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:37.742974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:37.781161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:37.807722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ae8b07-fb2e-4b21-8bf0-240d32a7bf62 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:37.812292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:37.844809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:37.845439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.845716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.845987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.847087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:37.848546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:37.849282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b7cff3-d31d-4474-b402-001f1c63801e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:37.851778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 152/302] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:37.851778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:37.889576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:37.890203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:37.890477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:37.890776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:37.901862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:37.907236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:37.908188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:37.909024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 151/303] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:37.909767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:37.961408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd233f52-8e8b-41f3-83cb-8082e83cbdcf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:37.999400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.000313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.000599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.000871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.001937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] RBAC: Adding query filter params (name=reader) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:38.002290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.003663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.015190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 153/304] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:38.016224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:38.018303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297b6889-8e46-4480-9f4c-bf0acd9ac06e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.020968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:38.050730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:38.060744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.061355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.061632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.061904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] PATH_INFO: `/v3/groups` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.062557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.064022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.080306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 152/305] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Sep 20 04:38:37 2022] POST /identity/v3/groups => generated 229 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:38:38.093099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:38.140618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc4359-3cc6-4195-89cd-5b3b756608bf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.181484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.182201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.182596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.182936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.183744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:38.184106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.185763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.201531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 154/306] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:38.203063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:38.254198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82b717b-986f-4878-98cb-613147b55de3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.283655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:38.295625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.297830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.298109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.298377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] PATH_INFO: `/v3/users/4ff4288e355043d38fdbd2958b969309` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.316406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] RBAC: Authorizing `identity:get_user(user_id=4ff4288e355043d38fdbd2958b969309)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.317903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.319893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 153/307] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:38 2022] GET /identity/v3/users/4ff4288e355043d38fdbd2958b969309 => generated 293 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:38.326191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:38.328071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b5bb35-5e4a-40bd-938f-8f59cb94b8a6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.366493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.367284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.367415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.367652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] PATH_INFO: `/v3/users/8c4f92bb239244d5a409efe29b4c3589` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.368812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] RBAC: Authorizing `identity:get_user(user_id=8c4f92bb239244d5a409efe29b4c3589)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.370242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.372178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 155/308] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:38 2022] GET /identity/v3/users/8c4f92bb239244d5a409efe29b4c3589 => generated 293 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:38.379566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:38.420149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:38.458298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d23a909-543f-4731-96ce-190d048bc67e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.492406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.493011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.493286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.493558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.494279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, user.id=4ff4288e355043d38fdbd2958b969309, scope.system=all) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:38.494595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.496039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b7cb43-a420-418c-9ae0-009182e4d77b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.501973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 154/309] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 20 04:38:38 2022] GET /identity/v3/role_assignments?user.id=4ff4288e355043d38fdbd2958b969309&scope.system=all&role.id=c40662578aa541a1897ea45391239390 => generated 226 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:38.503275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccaa0d-ac59-409a-8850-9a411d3f9080 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.503563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccaa0d-ac59-409a-8850-9a411d3f9080 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.503859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caccaa0d-ac59-409a-8850-9a411d3f9080 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.505319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 155/310] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:38.511068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.511348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.511610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.518322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d146838-241e-44f5-aca3-c03d4b5f4a95 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:38.533377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:38.534857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:38.564713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:38.566220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:38.566752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:38.567188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] PATH_INFO: `/v3/system/users/8c4f92bb239244d5a409efe29b4c3589/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:38.569756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=8c4f92bb239244d5a409efe29b4c3589, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:38.571366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:38.573442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:38.591762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 156/311] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Sep 20 04:38:38 2022] PUT /identity/v3/system/users/8c4f92bb239244d5a409efe29b4c3589/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:38.625698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 156/312] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:38.901734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.007819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014d93e4-a2a3-4472-9c86-f364ff722135 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:39.043658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:39.044663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:39.045170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:39.045632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:39.056401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:39.062219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:39.063238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:39.064056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:39.066871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 157/313] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:39.073076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.119469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:39.182455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0436eb3f-83a5-4ecc-9244-2290703f57bb None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:39.223004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:39.223674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:39.224264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:39.224585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:39.225251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:39.225551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:39.226914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:39.239332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 157/314] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:39.241823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.306244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:39.351820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260a451c-e6de-4119-83f5-c00c19469a82 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:39.387182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:39.387843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:39.388121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:39.388387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] PATH_INFO: `/v3/users/c1627706f08c477184fd972faeab1183` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:39.389586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] RBAC: Authorizing `identity:get_user(user_id=c1627706f08c477184fd972faeab1183)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:39.391318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:39.397824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 158/315] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:39 2022] GET /identity/v3/users/c1627706f08c477184fd972faeab1183 => generated 297 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:39.399187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.510555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b7f84c-422d-4e17-9444-7f5e98aeff29 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:39.512248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:39.551230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:39.551879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:39.552158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:39.552427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:39.621360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:39.622969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:39.726461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 158/316] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:39.727852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.838654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da96fd7-3655-460a-a8e7-ffb1b450df0a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:39.864941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:39.873926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:39.874963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:39.875638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:39.875973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:39.877166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:39.878602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f2f199-0dd6-44b8-aa68-9c9fa10a175c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:39.880245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 159/317] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:39 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:39.886140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:39.888561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:39.993982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e05a7a-65d1-4202-bacf-1f73500a25d4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:40.028972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:40.029579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.029853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.030124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.030841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a, user.id=c1627706f08c477184fd972faeab1183) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:40.031146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:40.033287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5700b-aab1-435e-a270-3bd3a793bd13 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:40.039560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 159/318] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:38:39 2022] GET /identity/v3/role_assignments?user.id=c1627706f08c477184fd972faeab1183&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=c40662578aa541a1897ea45391239390 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:40.442335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab705-5e26-4b96-83fb-5544c9a428e6 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.442855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab705-5e26-4b96-83fb-5544c9a428e6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.444076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79ab705-5e26-4b96-83fb-5544c9a428e6 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.444776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 160/319] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:40.450564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caffd97-704a-4bcb-a268-036715917d37 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.451095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caffd97-704a-4bcb-a268-036715917d37 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.451095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caffd97-704a-4bcb-a268-036715917d37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.469257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1caffd97-704a-4bcb-a268-036715917d37 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:40.470454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1caffd97-704a-4bcb-a268-036715917d37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:40.531600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:40.540936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 160/320] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:40.728092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e369ad-7f62-4eee-b3ff-12014269a5e8 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.728598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e369ad-7f62-4eee-b3ff-12014269a5e8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.728704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e369ad-7f62-4eee-b3ff-12014269a5e8 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.729952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 161/321] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:40.735217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7a83-a17f-494b-b24e-73127edc061d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.735508 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7a83-a17f-494b-b24e-73127edc061d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.735825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9b7a83-a17f-494b-b24e-73127edc061d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.754419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3c9b7a83-a17f-494b-b24e-73127edc061d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:40.755654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3c9b7a83-a17f-494b-b24e-73127edc061d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:40.812396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e369ad-7f62-4eee-b3ff-12014269a5e8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:40.826723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 161/322] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:40.877636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c200-9d0b-4795-9f7c-356c4bc23278 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.877921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c200-9d0b-4795-9f7c-356c4bc23278 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.878397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f2c200-9d0b-4795-9f7c-356c4bc23278 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.880168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 162/323] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:40.885081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.885550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.885998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.907496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:40.909132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:40.915164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e369ad-7f62-4eee-b3ff-12014269a5e8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:40.949604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:40.950233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:40.950512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:40.950782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:40.951912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:40.953900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:40.955628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 162/324] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:38:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:40.961093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:40.982450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 163/325] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:41.023576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.063268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ecf14-f138-467d-9df2-134349091264 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.096714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.097320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.097594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.097860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] PATH_INFO: `/v3/groups` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.098479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.099928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.102785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.119443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 163/326] 10.222.0.42 () {60 vars in 1134 bytes} [Tue Sep 20 04:38:40 2022] POST /identity/v3/groups => generated 226 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:38:41.166735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.216016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2f99f4-3d7a-45ff-95c1-988335b7bc52 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.252988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.253170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.253547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.253826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.254111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.268601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:41.273870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:41.274978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:41.275853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 164/327] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:41.281099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.373355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b568aaa-ee59-4b26-9c6c-95a92e8c7b73 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.402164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.402371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1248f5-ac69-49c5-b203-46543814c3f0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.422634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.422931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.423490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.424747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.424747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.439669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:41.445164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:41.446084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:41.446887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 164/328] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:41.452150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.454175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.454622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.454889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.455154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.456514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:41.457319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.458735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.469711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 165/329] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:41.475149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.583607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba98c74-168f-4467-9983-1e932b40ba60 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.599559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8001fd5-6d6f-4d6f-802c-524c0f962ae9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.627535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.628598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.629097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.629585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.630519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:41.631082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.632745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.640663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.641929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.642180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.642449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] PATH_INFO: `/v3/users/4ff4288e355043d38fdbd2958b969309` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.643545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 165/330] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:41.644444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] RBAC: Authorizing `identity:get_user(user_id=4ff4288e355043d38fdbd2958b969309)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.646165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.647934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 166/331] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/users/4ff4288e355043d38fdbd2958b969309 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:41.649326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.653229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.705361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.719005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:41.775120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57ac070-dd10-430f-a951-96d6ea41d77e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.793636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f5f0ec-eed5-499d-8766-a0c0aa6e4c2d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.820242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.821034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.821418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.821789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] PATH_INFO: `/v3/users/8c4f92bb239244d5a409efe29b4c3589` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.823066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] RBAC: Authorizing `identity:get_user(user_id=8c4f92bb239244d5a409efe29b4c3589)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.824671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.826656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 166/332] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/users/8c4f92bb239244d5a409efe29b4c3589 => generated 293 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:41.833223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:41.838545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:41.839402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:41.839850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:41.840262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] PATH_INFO: `/v3/system/users/4ff4288e355043d38fdbd2958b969309/roles/c40662578aa541a1897ea45391239390` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:41.841940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=4ff4288e355043d38fdbd2958b969309, role_id=c40662578aa541a1897ea45391239390)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:41.843449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4616965a-89a6-40d5-9e12-7118868d9d57 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:41.857016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 167/333] 10.222.0.42 () {58 vars in 1334 bytes} [Tue Sep 20 04:38:41 2022] PUT /identity/v3/system/users/4ff4288e355043d38fdbd2958b969309/roles/c40662578aa541a1897ea45391239390 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:38:41.967056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f861-d9e6-4f6b-8e02-119c0bf16aac None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:41.982794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:42.013517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:42.014166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:42.014445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:42.014715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:42.015473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] RBAC: Adding query filter params (role.id=791fea6050e741c0824356b63aa26aea, user.id=8c4f92bb239244d5a409efe29b4c3589, scope.system=all) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:42.016363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:42.017933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c98cec1-645b-4db6-b754-a69640dbaddb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:42.039176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 167/334] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 20 04:38:41 2022] GET /identity/v3/role_assignments?user.id=8c4f92bb239244d5a409efe29b4c3589&scope.system=all&role.id=791fea6050e741c0824356b63aa26aea => generated 510 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:43.641776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac6c-2d9c-4049-bb81-797af4774a32 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:43.642308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac6c-2d9c-4049-bb81-797af4774a32 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:43.642308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1798ac6c-2d9c-4049-bb81-797af4774a32 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:43.643970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 168/335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:43.649697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:43.650144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:43.650237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:43.674571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:43.675792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:43.750854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 168/336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:44.188651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ac6c-2d9c-4049-bb81-797af4774a32 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:44.329947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1798ac6c-2d9c-4049-bb81-797af4774a32 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:44.352564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:44.373729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:44.374366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.374640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.374942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.392226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3d4d2130-8aa1-4adf-84f1-9b5f8f65b223 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:44.397421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:44.398317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:44.399128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 169/337] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:44.404370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:44.447966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e20d-7815-4adf-897c-29271f2d8cf6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.448305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e20d-7815-4adf-897c-29271f2d8cf6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.448582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a53e20d-7815-4adf-897c-29271f2d8cf6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.450152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 170/338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:44.457008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab86f3-7584-4bc4-ba3f-6da94b86bc93 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.457284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab86f3-7584-4bc4-ba3f-6da94b86bc93 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.457574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab86f3-7584-4bc4-ba3f-6da94b86bc93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.501201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-87ab86f3-7584-4bc4-ba3f-6da94b86bc93 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:44.502437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-87ab86f3-7584-4bc4-ba3f-6da94b86bc93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:44.610515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:44.615753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7117777c-e168-4691-9cfa-41f3a697f277 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:44.652775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 171/339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:44.655056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589e6c-fb87-416b-aa32-14520f1d456f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.655545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589e6c-fb87-416b-aa32-14520f1d456f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.660030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09589e6c-fb87-416b-aa32-14520f1d456f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.661602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 172/340] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:44 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:44.667283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.667956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.668433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.685206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:44.685850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.686118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.686393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.687066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:44.687369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:44.689325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:44.701227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:44.702707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:44.707247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 169/341] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:44.712873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:44.812125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 173/342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:44.886639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38889dd0-a36f-452a-9587-1b983ce65967 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:44.931419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:44.932070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:44.932351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:44.932624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:44.967967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.018797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.020310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.096815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.135513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.151768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 170/343] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 04:38:45.156369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.258011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db59602b-af30-47f5-b793-0f6a37d79ec4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.278899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.330140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.330788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.331063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.331351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.341069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88454064-d398-4b5a-a1f8-f9a400c15aae None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.343498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-603d5e8d-86a6-407c-af71-3d8a6df26079 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:45.348402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:45.349316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 174/344] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/roles/reader => generated 84 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:45.355684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964619db-0fd9-4f9b-94e5-52499b6b8975 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.356448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964619db-0fd9-4f9b-94e5-52499b6b8975 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.356448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-964619db-0fd9-4f9b-94e5-52499b6b8975 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.356448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 175/345] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:45.356448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964619db-0fd9-4f9b-94e5-52499b6b8975 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.389766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.391519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.393790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.394325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.395950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.397653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.399492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 171/346] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:45.400510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.458779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.469937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-964619db-0fd9-4f9b-94e5-52499b6b8975 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.515256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.516437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.516697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.517131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.519228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56a3da7f-af3f-4972-b093-6afb5868a325 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.530958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5702dc3e-70a7-4926-a98d-41fd943ffe49 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:45.537496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:45.538703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:45.539714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:45.546186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 176/347] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:45.549784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.550073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.550352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.571218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.576029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:45.578194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:45.578857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.579554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.579924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.580344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.581172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] RBAC: Adding query filter params (name=reader) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:45.581540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.583015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.593212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 172/348] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:45.594556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.678452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 177/349] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:45.679785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.728034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c776e5-b0b7-4025-b925-b1d8ce98dfbc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.765876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.766429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.766702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.766976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.776272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.777737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.779355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 173/350] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:45.780884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.799078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.826253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e47181-6d22-49b4-bf17-3b6faefb5154 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.862242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:45.876733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.878199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.878675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.879149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.880049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:45.880684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.882427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.894346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 178/351] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:45.895507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:45.921717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb840e9f-fb0e-4219-847b-63470c2ccdf4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:45.966224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:45.967182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.967697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.968200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] PATH_INFO: `/v3/users/4ff4288e355043d38fdbd2958b969309` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.970104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] RBAC: Authorizing `identity:get_user(user_id=4ff4288e355043d38fdbd2958b969309)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:45.972278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab195f2-693a-4f03-84e6-e873f2105270 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:45.975411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 174/352] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/users/4ff4288e355043d38fdbd2958b969309 => generated 293 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:45.977143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d604-1a54-4fbe-abff-3a9e58190428 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:45.977659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d604-1a54-4fbe-abff-3a9e58190428 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:45.978139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e433d604-1a54-4fbe-abff-3a9e58190428 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:45.979858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 175/353] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:45.981097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d604-1a54-4fbe-abff-3a9e58190428 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.033474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544f1f32-a6ff-4476-82da-a755a30ee840 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.072387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.073378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.073913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.074392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.075399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=8c959789b1364446916fb2b71eb40efe) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:46.076670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:46.077316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:46.084405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 179/354] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=791fea6050e741c0824356b63aa26aea => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:46.092824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.106263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.127392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e433d604-1a54-4fbe-abff-3a9e58190428 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.164377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.172953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.174061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.174473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.174945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.238874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706d67ed-178b-401d-b925-c6af4830a629 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.268852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:46.270897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-430adc4d-e39a-43e3-b9d6-31bb6478e552 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:46.289321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.289972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.290322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.290710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.305405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:46.310745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:46.311750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:46.313727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 180/355] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:46.314468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.402964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.416481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 176/356] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:46.418490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.419004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.419484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.445289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:46.446832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:46.455794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a48cbd3-d867-4fe6-a656-f0b899b933ab None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.472230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.494625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.495237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.495511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.495815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.496548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] RBAC: Adding query filter params (role.id=c40662578aa541a1897ea45391239390, user.id=4ff4288e355043d38fdbd2958b969309, scope.system=all) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:46.496850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:46.498278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:46.510900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 181/357] 10.222.0.42 () {56 vars in 1308 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/role_assignments?user.id=4ff4288e355043d38fdbd2958b969309&scope.system=all&role.id=c40662578aa541a1897ea45391239390 => generated 510 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:46.511756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.537528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 177/358] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:46.538470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.650254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846539b9-3f76-48f7-a369-df52917acc38 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.684093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.692641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.693496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.693973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.694425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.695372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] RBAC: Adding query filter params (name=member) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:46.695677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:46.697321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df1ce4-0767-4d7f-9a0b-574a72782676 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:46.708138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 182/359] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:46.709449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4385de-3224-4977-8e79-d5d4e027c552 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.710114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4385de-3224-4977-8e79-d5d4e027c552 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.710114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4385de-3224-4977-8e79-d5d4e027c552 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.711319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 183/360] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:46.716975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.717312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.717678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.753674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3a10e-9f81-4c70-b922-e7ed55673839 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:46.755517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:46.756829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:46.811137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:46.811834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:46.812112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:46.812383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:46.815700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:46.817444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:46.820057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 178/361] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:46.820921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.855421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:46.883454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 184/362] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:46.884803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:46.961219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f64066-3747-41ae-8528-8db934c9b3ce None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.002339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.003135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.003499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.004188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.030404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70181b93-0f14-4415-a3b8-efa42e70b913 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.056131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.080581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.081334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.081608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.082197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.083634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.085716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.087649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 185/363] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.088290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.097447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.098976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.124395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.212025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9247df39-bdd0-4081-b302-fbe29a717741 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.222159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 179/364] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:47.223035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.254491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.255559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.256144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.256593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.272366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:47.279863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:47.280772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:47.281645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 186/365] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:47.282341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.345617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.352098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7e870c-c4e4-4b9b-8749-f75e5d106b6c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.381443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.395599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.396491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.396765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.397034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.397762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=8c959789b1364446916fb2b71eb40efe) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:47.398071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.399514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.407410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 180/366] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=7da111f273124548ab0a4deafd90a54f => generated 260 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.412779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.425366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e9ac3e-c434-4895-8a52-7bd9fa2726b7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.491495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.492557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.493108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.493793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.510510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:47.516681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:47.517640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:47.518468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 187/367] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:47.519146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.592630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226f1e00-2669-419b-80b4-8b45f774506e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.640309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.640309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.640309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.640309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.645032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.646716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.648746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 181/368] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.649570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.667620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec58c34d-55b9-4095-a20e-8bcbef3378c5 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.671314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.710350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.710977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.711239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.711511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.712209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:47.712513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.713877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.727163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 188/369] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.732676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.734472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:47.796920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9f573-b489-4f2c-8901-78a1b27b0a4c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.843012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.844883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.845163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.845434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.846109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:47.846409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.847818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.856531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 182/370] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.857187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.882545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9266653a-30cb-432d-966b-5fbb3eddcf28 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:47.931986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:47.932520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:47.932871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:47.933226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:47.934429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:47.936093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:47.938226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 189/371] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:47.944603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:47.999595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2676e3e-aaf3-41d4-9029-c04f4514f6e5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.010819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.028208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.057004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.057539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.057819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.058092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.106760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa179bb-7df9-4969-91c2-5a1ea2eb33fc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.155913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.157455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.157915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.158642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.159265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.160867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.247054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.248681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.271101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 183/372] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:48.272269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.290747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.300825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.376990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f14db1-ded5-461e-9fbb-c170bc92d016 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.377664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 190/373] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:48.378625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.416346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.417238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.417685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.418121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.419037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:48.419512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.422190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.428215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 184/374] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=791fea6050e741c0824356b63aa26aea => generated 260 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:48.429222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.504548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3837479-8785-4bb8-b82e-d69496f9d7bc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.522121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.558874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ad82b7-c5cf-4a59-ad88-e1944d30639a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.562086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.563306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.563585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.563886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.565285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.566766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.568563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 191/375] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:48.576711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.580583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.642831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.643422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.643705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.644052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] PATH_INFO: `/v3/projects/8b96017b54824414bda6d5bbb2079fd6` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.647137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] RBAC: Authorizing `identity:get_project(project_id=8b96017b54824414bda6d5bbb2079fd6)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.650708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.657678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 185/376] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/projects/8b96017b54824414bda6d5bbb2079fd6 => generated 344 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:48.663543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.740176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b173ae-1f26-4f10-90fd-7b61c58f4521 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.775661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.776321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.776598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.776872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.777994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.779427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5227ff0a-f5c3-49c4-a17e-21d1174c3adb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.781440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 192/377] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:48.782934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51f65-1942-4927-9545-6032f03e1926 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.783218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51f65-1942-4927-9545-6032f03e1926 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.783490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de51f65-1942-4927-9545-6032f03e1926 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.788885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 193/378] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:48.789718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de51f65-1942-4927-9545-6032f03e1926 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.789854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f59a86-0d84-49e2-9caf-cd71397c5aff None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.834633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.835394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.835698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.836002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] PATH_INFO: `/v3/groups/682c31a568614b489d52097c0aa26ee2` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.841441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] RBAC: Authorizing `identity:get_group(group_id=682c31a568614b489d52097c0aa26ee2)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.843182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e4eac7-d431-4b13-a9b9-3f3e0ce819e6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.845485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 186/379] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/groups/682c31a568614b489d52097c0aa26ee2 => generated 229 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:48.846838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.847172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.847555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.868334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.868543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:48.870029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:48.879228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:48.905224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de51f65-1942-4927-9545-6032f03e1926 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:48.944801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:48.945515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:48.945787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:48.946060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:48.946890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:48.947198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:48.948671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:48.955073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 187/381] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:48.956286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:48.958967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 194/381] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=7da111f273124548ab0a4deafd90a54f => generated 260 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:49.069834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8cd548-02a1-4542-b676-67a6eb4e4a10 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:49.110750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:49.111757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:49.112258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:49.112773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:49.113756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] RBAC: Adding query filter params (group.id=682c31a568614b489d52097c0aa26ee2, role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=8b96017b54824414bda6d5bbb2079fd6) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:49.114298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:49.115998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:49.124219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 188/382] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:48 2022] GET /identity/v3/role_assignments?group.id=682c31a568614b489d52097c0aa26ee2&scope.project.id=8b96017b54824414bda6d5bbb2079fd6&role.id=307985de8d134d4587aac9def1fcad5c => generated 260 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:49.274615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:49.398273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55fa2646-9afa-4e59-9a4e-470f219bccfb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:49.445057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:49.445949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:49.446427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:49.446897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:49.449079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:49.460486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:49.466774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:49.467690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:49.468566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:49.471397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 195/383] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:49.477354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:49.487886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:49.610661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0854fcad-c395-4933-8a4f-0b32d855437a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:49.657249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:49.657884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:49.658146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:49.658422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:49.659089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:49.659391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:49.660797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:49.675858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 189/384] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:49.681696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:49.811161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea7ce8b-d790-42ff-9423-2c2950c5b8a5 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:49.857652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:49.858292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:49.858573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:49.858848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:49.860168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:49.861712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:49.863556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 196/385] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:49 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:49.868973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:49.963839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:50.003553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deebb2dc-1cbe-49cc-86d4-5928e5d11ea0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:50.044053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:50.044758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:50.045038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:50.045315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:50.046477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:50.048551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b2f38dd-e52a-499b-950d-bef9d1a21463 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:50.050512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 190/386] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:49 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:50.056507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:50.099782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc8a-934a-427b-8fce-1e8d5530401b None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:50.100082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc8a-934a-427b-8fce-1e8d5530401b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:50.100323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5bc8a-934a-427b-8fce-1e8d5530401b None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:50.101864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 191/387] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:50.107089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:50.107631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:50.108187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:50.132232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:50.133736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:50.135219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:50.196567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f199d92-f695-44aa-a6e4-a3181423e92d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:50.241514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 192/388] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:50.258438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:50.259437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:50.259995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:50.260469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/groups/6ca358e213a34a68a47e5821fa439218/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:50.262647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, group_id=6ca358e213a34a68a47e5821fa439218, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:50.264392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:50.281022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 197/389] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 20 04:38:50 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/groups/6ca358e213a34a68a47e5821fa439218/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:50.668017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:50.746189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:50.794957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538d937a-a13f-458c-8f82-5ba135d288cf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:50.831845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:50.832840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:50.833325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:50.833807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:50.845335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:50.850515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:50.851461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:50.852320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:50.854660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 193/390] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:50.861212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:50.996296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e39f13d4-46c7-45ae-af07-86b185af71c3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:51.022637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:51.043625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:51.044740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.045114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.045434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.046251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:51.046554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:51.048782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1e79f-cad5-48f9-88ad-014f40f5f183 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:51.061022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 198/391] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:51.067193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:51.110202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa60616-9fd5-4c03-a19f-5f68e4c0f6f0 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.110554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa60616-9fd5-4c03-a19f-5f68e4c0f6f0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.110740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa60616-9fd5-4c03-a19f-5f68e4c0f6f0 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.112395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 199/392] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:51.119479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.119810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.120070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.153218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:51.154428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:51.244380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a064679-a693-490e-9e37-0fc1fae78c26 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:51.289072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 200/393] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:51.289715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:51.301406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:51.302107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.302387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.302658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.304181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:51.308249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:51.310405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 194/394] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:51 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:51.315546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:51.428501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ebea84-341a-4836-a57c-70428d91a862 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:51.449663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:51.464837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:51.465466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.465742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.466006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.467134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:51.468593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:51.470564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 201/395] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:51 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:51.476235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:51.582370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4764b37-f5d4-4539-a633-4e6edcb20bbd None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:51.631452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:51.632329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.632602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.632970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe/groups/6ca358e213a34a68a47e5821fa439218/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.636198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] RBAC: Authorizing `identity:create_grant(project_id=8c959789b1364446916fb2b71eb40efe, group_id=6ca358e213a34a68a47e5821fa439218, role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:51.637621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:51.664425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 195/396] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 20 04:38:51 2022] PUT /identity/v3/projects/8c959789b1364446916fb2b71eb40efe/groups/6ca358e213a34a68a47e5821fa439218/roles/7da111f273124548ab0a4deafd90a54f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:51.769753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:51.898296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c304868d-7aa0-4045-9ad3-27b91c621f43 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:51.940083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:51.941081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:51.941555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:51.942020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:51.955153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-256ceef1-13b8-4aa2-9372-2276e73769e3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:51.960509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:51.961501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:51.962312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:51.964983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 202/397] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:51.971151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.007752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042362-928f-445b-b5b0-784a1e843038 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.008106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042362-928f-445b-b5b0-784a1e843038 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.008324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9042362-928f-445b-b5b0-784a1e843038 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.010033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 203/398] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:52.015585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.015934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.016212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.037426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:52.037733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:52.072532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.077326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.121279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 204/399] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:52.133453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ae51d1-70b5-4a24-8385-9a4cdda68837 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:52.175645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:52.176607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.177099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.177592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.178515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:52.179010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:52.180608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:52.189576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 196/400] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:52.195362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.345034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b53002-4173-4d74-a277-e269a694ea8c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:52.390142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:52.391347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.391628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.391927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.396674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:52.398183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:52.400151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 205/401] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:52 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:52.405487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.545264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c909195-47cb-4063-9f52-a1db1db65627 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:52.569019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.590861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.593265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:52.594524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.594801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.595126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.596297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:52.597715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:52.599627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 197/402] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:52 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:52.607181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.648449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.715651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a88252-abd8-4a05-adee-e50f1a4f42b6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:52.739699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634d0e5d-3dd9-4106-b91f-9e9d6a7ec750 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:52.754109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:52.754899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.755272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.755646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.767765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4f2f597f-bbab-48a6-8d70-2854199e3894 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:52.773554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:52.774483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:52.775455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 206/403] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:52.777485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487d3-9bc4-46c1-b0bf-cc6eda987be6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.777867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487d3-9bc4-46c1-b0bf-cc6eda987be6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.778241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54487d3-9bc4-46c1-b0bf-cc6eda987be6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.780604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 207/404] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:52.781925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54487d3-9bc4-46c1-b0bf-cc6eda987be6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:52.787486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:52.788428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.788850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.789260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/groups/6ca358e213a34a68a47e5821fa439218/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.791887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, group_id=6ca358e213a34a68a47e5821fa439218, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:52.793936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc82b92f-e14e-49d9-84f5-4dcc4f7247eb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:52.815888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 198/405] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 20 04:38:52 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/groups/6ca358e213a34a68a47e5821fa439218/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:52.818283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:52.818643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:52.818866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:52.855466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:52.861967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:52.972563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.985468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:52.992832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54487d3-9bc4-46c1-b0bf-cc6eda987be6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.036391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.037020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.037298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.037582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.038253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:53.038558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:53.039986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:53.050864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 208/406] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:53.056234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.063780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 199/407] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:53.176861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ba6c01-2901-441a-904b-677559a4dae2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.218249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.218915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.219197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.219470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.222052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:53.223669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0877187c-7736-4974-b3ea-850af2d433a1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:53.225547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 209/408] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:53.230645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.240556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59195-8774-4c57-a046-d5126db47f2c None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.240842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59195-8774-4c57-a046-d5126db47f2c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.241119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa59195-8774-4c57-a046-d5126db47f2c None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.242663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 210/409] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:53.247440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.247723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.248027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.266440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:53.267623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:53.292394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:53.352478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 211/410] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:53.359990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.402965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0656f2-cc57-4e89-b97c-0380d0b6f391 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.464285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.464930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.465212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.465490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.467382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:53.468984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:53.476470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 200/411] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:53.479936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.548352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e259dc7a-922a-4bdc-9911-69cfd41ac570 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.563521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:53.594967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.595656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.595959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.596230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.613200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:53.618030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:53.619027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:53.619865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:53.628195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 212/412] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:53.634205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.637181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf17c75-a4ed-47db-9ffc-399489ab42d0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.670061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:53.676461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.677394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.677945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.678363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/groups/6ca358e213a34a68a47e5821fa439218/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.680889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a, group_id=6ca358e213a34a68a47e5821fa439218, role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:53.682579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:53.702417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 201/413] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 20 04:38:53 2022] PUT /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a/groups/6ca358e213a34a68a47e5821fa439218/roles/7da111f273124548ab0a4deafd90a54f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:53.709388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.801396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6951760a-c4a2-4df2-a8df-fedb251be460 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.870654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.871274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.871551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.871845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.872524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:53.872824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:53.874215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:53.888605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 213/414] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:53.896259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:53.914852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8d06ed-597e-4a89-af77-65efdf7c23a3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:53.916543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:53.968501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:53.970075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:53.970673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:53.971764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] PATH_INFO: `/v3/roles/member` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:53.988308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:53.996040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:53.996962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:53.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:54.000959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 202/415] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:54.005664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:54.010265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:54.036335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fc237f-f11d-43a8-95cf-b08d5ce3b13a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:54.082715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:54.083715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.084231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.084778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] PATH_INFO: `/v3/groups/682c31a568614b489d52097c0aa26ee2` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.086397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] RBAC: Authorizing `identity:get_group(group_id=682c31a568614b489d52097c0aa26ee2)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:54.088407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:54.090240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 214/416] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:53 2022] GET /identity/v3/groups/682c31a568614b489d52097c0aa26ee2 => generated 229 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:54.096914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:54.201977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746f7535-8b5f-431a-a616-9c0d2e9f592a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:54.243477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3574e77-1ee2-4782-bcc6-df3eef64b768 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:54.273495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:54.274066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.274312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.274539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.275211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] RBAC: Adding query filter params (name=member) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:54.275533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:54.276932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:54.283664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:54.285737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.286237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.286732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] PATH_INFO: `/v3/projects/8b96017b54824414bda6d5bbb2079fd6` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.289282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] RBAC: Authorizing `identity:get_project(project_id=8b96017b54824414bda6d5bbb2079fd6)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:54.290962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:54.293095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 203/418] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:54.293346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 215/418] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:54 2022] GET /identity/v3/projects/8b96017b54824414bda6d5bbb2079fd6 => generated 344 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:54.302483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:54.302642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:54.325674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:54.373600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:54.417724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ce9d07-f0b3-481e-b8ff-64bfd24e2063 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:54.482649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:54.483306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.483586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.483880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.533688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae55a04b-0a29-4999-83c7-62a3863266b2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:54.569877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:54.570656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.570936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.571206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] PATH_INFO: `/v3/projects/8b96017b54824414bda6d5bbb2079fd6/groups/682c31a568614b489d52097c0aa26ee2/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.573232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] RBAC: Authorizing `identity:create_grant(project_id=8b96017b54824414bda6d5bbb2079fd6, group_id=682c31a568614b489d52097c0aa26ee2, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:54.574766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb204f7-196a-4de2-ade1-5e8ae5c6364e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:54.585790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:54.588118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:54.595819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 204/419] 10.222.0.42 () {58 vars in 1442 bytes} [Tue Sep 20 04:38:54 2022] PUT /identity/v3/projects/8b96017b54824414bda6d5bbb2079fd6/groups/682c31a568614b489d52097c0aa26ee2/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:38:54.595819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfd258-af26-4dcc-9bbb-f5af795a508c None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.595819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfd258-af26-4dcc-9bbb-f5af795a508c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.595819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcfd258-af26-4dcc-9bbb-f5af795a508c None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.595819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 205/420] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:54.609701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:54.610006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:54.610308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:54.642198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:54.642623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:54.647253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:54.777370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 206/421] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:54.814143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 216/422] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 04:38:54.819913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:54.837435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:54.964309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7fd6fd-6a4d-47ce-bd1e-ffa8f38460f1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.013471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.014113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.014392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.014662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.015866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:55.017301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:55.019221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 207/423] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:54 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:55.024611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.177000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58af8b4e-e979-4420-bba7-56d74ef09f70 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.202599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:55.224011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450298-488a-464b-b018-87c633a10f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.224561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450298-488a-464b-b018-87c633a10f26 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.224834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450298-488a-464b-b018-87c633a10f26 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.225162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31450298-488a-464b-b018-87c633a10f26 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.226266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31450298-488a-464b-b018-87c633a10f26 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:55.228024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31450298-488a-464b-b018-87c633a10f26 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:55.229890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 217/424] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:55.233411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.240286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450298-488a-464b-b018-87c633a10f26 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.360828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31450298-488a-464b-b018-87c633a10f26 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.398308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.399274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.399776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.400248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.401349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=8c959789b1364446916fb2b71eb40efe) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:55.401885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:55.403511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28682c3-df9c-4536-8cb7-a0bece6d1f91 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:55.410525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 218/425] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=791fea6050e741c0824356b63aa26aea => generated 611 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:55.431790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cdf9c-af2c-4cb5-9078-d74a36624176 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.432396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cdf9c-af2c-4cb5-9078-d74a36624176 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.432912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9cdf9c-af2c-4cb5-9078-d74a36624176 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.434906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 219/426] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:38:55.440555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.441125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.441622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.463054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:55.464754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:55.476558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:55.518188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2169f75e-06b9-4e48-a7cb-63531684b64e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.548180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:55.557334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 220/427] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:55.584829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff524-0281-4364-961a-a12a305419eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.585913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff524-0281-4364-961a-a12a305419eb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.586416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff524-0281-4364-961a-a12a305419eb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.586885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaff524-0281-4364-961a-a12a305419eb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.600847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaff524-0281-4364-961a-a12a305419eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-acaff524-0281-4364-961a-a12a305419eb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:55.606279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:55.607230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:55.608168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:55.611619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 208/428] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:38:55.620971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.736094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb401d77-2154-4719-8041-f2c03ebce327 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.773997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.774603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.774884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.775154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.775840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:55.776173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:55.777515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:55.786816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 221/429] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:55.792247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff524-0281-4364-961a-a12a305419eb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.878437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:55.917783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaff524-0281-4364-961a-a12a305419eb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:55.945171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:55.962318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:55.963894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:55.964430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:55.964906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:55.981479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.000638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4d9036-2c8e-4dff-8dea-8bdbaf206e11 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.042986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.044306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.044755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.045174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.050687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.052621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.056216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:56.063484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:56.064563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 20 04:38:56.065392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:38:56.068042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 222/430] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:56.073550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.207624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 209/431] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:56.212463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.215157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8d18f2-897b-4aad-a801-69c01da28cd4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.217585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.266764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.267763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.268257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.268829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.269711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] RBAC: Adding query filter params (name=member) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:56.272426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.273207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.275536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.295678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 223/432] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:56.302960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.343056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0beb98-3c72-4952-9687-062e4d048ff4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.397391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.398086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.398361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.398629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] PATH_INFO: `/v3/projects/8c959789b1364446916fb2b71eb40efe` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.399803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] RBAC: Authorizing `identity:get_project(project_id=8c959789b1364446916fb2b71eb40efe)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.401706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b733702a-aac7-4d22-917b-371599b936c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.404053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 210/433] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/projects/8c959789b1364446916fb2b71eb40efe => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:56.405511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fce45-c4e6-4cbe-936a-10257008e908 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.405792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fce45-c4e6-4cbe-936a-10257008e908 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.406069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406fce45-c4e6-4cbe-936a-10257008e908 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.408007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 211/434] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:56.412567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fce45-c4e6-4cbe-936a-10257008e908 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.437935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d5fc32-2d31-49bc-ac43-a090b356f364 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.478712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.479329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.479607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.479932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.518087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.536980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406fce45-c4e6-4cbe-936a-10257008e908 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.548659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.560714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.562188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.574361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.575070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.575350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.575618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.576766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.578783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb1a611-1bfe-4108-a0e2-f859323fcaca None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.585162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 212/435] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:56.585162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.585162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.585162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.600829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:56.602009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:56.672961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 213/436] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:38:56.673796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 224/437] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:56.674573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.684950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.750831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.803627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352a7fcc-0b1b-4c53-b5c0-00b1e5fd320b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.806580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db06eab5-0cb2-4095-b9a1-efdb1242fc69 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:56.816958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:56.845989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.846943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.847391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.847862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.848458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:56.849135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:56.849585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:56.849880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.849995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:56.850721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=8c959789b1364446916fb2b71eb40efe) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:56.851099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:56.851986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.852711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:56.853955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 225/438] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:56.859527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.859638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 214/439] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=8c959789b1364446916fb2b71eb40efe&role.id=7da111f273124548ab0a4deafd90a54f => generated 611 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:56.976223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:56.976818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7196696-651b-43fb-bd50-afc43554021f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.020121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.028644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.029455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.029838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.030214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.032695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.034744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.037028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 226/440] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:57.043618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.111547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c07ddb-e739-40e8-8add-83820d378aa9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.152954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.154645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.154928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.155198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.173558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:57.175018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5753008-e701-4c41-8cc0-43b51f36d242 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:57.182856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:57.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:57.184879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 215/441] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:38:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:57.190105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.217323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.217521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.217807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.218065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.218851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=791fea6050e741c0824356b63aa26aea, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:57.219672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.222081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81df7184-c966-435c-a18f-c41c12da5c25 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.228657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 227/442] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=791fea6050e741c0824356b63aa26aea => generated 611 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:57.231761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818c58-a99b-4db5-830a-c7349b244277 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.231761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818c58-a99b-4db5-830a-c7349b244277 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.231761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26818c58-a99b-4db5-830a-c7349b244277 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.232959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 228/443] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:38:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:38:57.237628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.245463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.245806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.246073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.272527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:38:57.273871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:38:57.329716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf15451-fb89-4fad-ab52-6ebeab52904f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.349124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.361682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 229/444] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:38:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:38:57.370836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.371460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.371764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.372025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.372691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:57.372987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.374406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.384787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 216/445] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:57.390322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.506767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50bc54e8-7ad6-4518-8200-a86cfaa3ac08 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.542662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.543280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.543535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.543822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.612547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.616800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.618537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.633250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.720332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 230/446] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:38:57.725831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.734078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.742466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09baa5c2-07ec-4b40-9d8f-3ced13c975d2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.775899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.776517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.776791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.777056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.787380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:38:57.792591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:38:57.793498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:38:57.794316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 217/447] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:38:57.800761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.819240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.826614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0398628-80c0-4f7c-828f-872c845d329b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.861137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.861761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.862039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.862312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] PATH_INFO: `/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.863580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] RBAC: Authorizing `identity:get_project(project_id=b306d6b06f224f58a2aeaaf8f9e35c6a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.865002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.866767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 231/448] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/projects/b306d6b06f224f58a2aeaaf8f9e35c6a => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:57.871921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.897553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366b975e-7c8b-4f70-b915-bb9bb3e5ab5e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:57.930573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:57.931171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:57.931505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:57.931803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:57.932476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:57.932775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:57.934175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:57.942736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 218/449] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:57.948264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:57.965976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:57.970901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c8023c-55dd-4894-bad9-47bd60d810c7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.003898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.004523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.004802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.005074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] PATH_INFO: `/v3/groups/6ca358e213a34a68a47e5821fa439218` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.006201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] RBAC: Authorizing `identity:get_group(group_id=6ca358e213a34a68a47e5821fa439218)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.007629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.009213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 232/450] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/groups/6ca358e213a34a68a47e5821fa439218 => generated 226 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:58.014858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:58.044492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:58.047465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85bd0816-e6b9-4cab-87d9-a82a2daf884b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.081116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.081730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.082010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.082309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.113920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00bc156-bd51-4416-985a-6c98e7346ba3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.147996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.149455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.151006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.151600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.151910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.152185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.152907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] RBAC: Adding query filter params (group.id=6ca358e213a34a68a47e5821fa439218, role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:58.153215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.154613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.160371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 233/451] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:58 2022] GET /identity/v3/role_assignments?group.id=6ca358e213a34a68a47e5821fa439218&scope.project.id=b306d6b06f224f58a2aeaaf8f9e35c6a&role.id=7da111f273124548ab0a4deafd90a54f => generated 611 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:38:58.168361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:58.256519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:38:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 20 04:38:58.262506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:58.360894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:58.369684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72377575-e3fe-4c53-87ea-fd4f951c6517 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.404945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.405586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.405863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.406136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] PATH_INFO: `/v3/projects/8b96017b54824414bda6d5bbb2079fd6` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.407872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] RBAC: Authorizing `identity:get_project(project_id=8b96017b54824414bda6d5bbb2079fd6)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.409310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.410931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 234/453] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:38:58 2022] GET /identity/v3/projects/8b96017b54824414bda6d5bbb2079fd6 => generated 344 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:58.416690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:58.519648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4bac17-8d36-495d-a65b-b57fcbe98a78 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.536264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:38:58.554080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.555046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.555325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.555588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] PATH_INFO: `/v3/groups/682c31a568614b489d52097c0aa26ee2` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.556701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] RBAC: Authorizing `identity:get_group(group_id=682c31a568614b489d52097c0aa26ee2)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.558118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac10dd6-b0de-4865-b8ff-01e5bad764b8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.559639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 220/454] 10.222.0.42 () {56 vars in 1180 bytes} [Tue Sep 20 04:38:58 2022] GET /identity/v3/groups/682c31a568614b489d52097c0aa26ee2 => generated 229 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:38:58.566168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:38:58.660687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5164683a-1521-43b4-bbc3-a52c9edd2c97 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:38:58.692604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:38:58.693200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:38:58.693461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:38:58.693731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:38:58.694445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] RBAC: Adding query filter params (group.id=682c31a568614b489d52097c0aa26ee2, role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=8b96017b54824414bda6d5bbb2079fd6) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:38:58.694751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:38:58.696190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ea3f4d-f9f3-4b9f-9797-1709ea1a25a7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:38:58.701624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 235/455] 10.222.0.42 () {56 vars in 1376 bytes} [Tue Sep 20 04:38:58 2022] GET /identity/v3/role_assignments?group.id=682c31a568614b489d52097c0aa26ee2&scope.project.id=8b96017b54824414bda6d5bbb2079fd6&role.id=307985de8d134d4587aac9def1fcad5c => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:01.320558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab31bf-81f2-4883-ad79-adfe1f570d44 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.321113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab31bf-81f2-4883-ad79-adfe1f570d44 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.321113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dab31bf-81f2-4883-ad79-adfe1f570d44 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.322661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 221/456] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:01.328807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5f15-e937-4e7e-9897-f61e4d8f1dd1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.329235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5f15-e937-4e7e-9897-f61e4d8f1dd1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.329423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b5f15-e937-4e7e-9897-f61e4d8f1dd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.356792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-407b5f15-e937-4e7e-9897-f61e4d8f1dd1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:01.358012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-407b5f15-e937-4e7e-9897-f61e4d8f1dd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:01.383943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:01.448826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:01.553432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc200-f7d7-47fa-bf49-69d59363ea57 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.553755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc200-f7d7-47fa-bf49-69d59363ea57 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.553977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899cc200-f7d7-47fa-bf49-69d59363ea57 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.555559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 222/458] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:01.560930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41050a-a83e-40ab-b358-80f726119d4f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.561217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41050a-a83e-40ab-b358-80f726119d4f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.561485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f41050a-a83e-40ab-b358-80f726119d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.586148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9f41050a-a83e-40ab-b358-80f726119d4f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:01.587237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9f41050a-a83e-40ab-b358-80f726119d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:01.677038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 237/459] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:01.872528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc200-f7d7-47fa-bf49-69d59363ea57 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:01.945157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f52-a038-4bf3-83d1-c14f2e50954f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.945478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f52-a038-4bf3-83d1-c14f2e50954f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.945717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77e1f52-a038-4bf3-83d1-c14f2e50954f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.947373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 238/460] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:01.951849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:01.952133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:01.952407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:01.986030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:01.987201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:01.990178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899cc200-f7d7-47fa-bf49-69d59363ea57 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.056084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.056716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.056987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.057252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.072150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.073603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.089000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 239/461] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:02.089946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:02.090835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:02.091720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:02.091720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.091720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:02.091921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.091989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 223/462] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:02.098403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.133133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.168127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.235943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-902483e5-d747-40d5-b6db-179e5e9832d0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.270324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.270930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.271460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.271757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.272420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:02.272718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.274069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36507a22-290a-486d-ab30-1afbe4784db9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.280010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a71f6-4fcf-410d-ae20-9150c1148991 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.286575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 224/463] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:02.287839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279fc8-ce2e-4701-9891-2f9ef6b9399a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.288129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279fc8-ce2e-4701-9891-2f9ef6b9399a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.288405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63279fc8-ce2e-4701-9891-2f9ef6b9399a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.289869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 225/464] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:02.291765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279fc8-ce2e-4701-9891-2f9ef6b9399a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.318263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.318902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.319176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.319448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.337557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.339007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-58d46e5d-9524-4f5e-b241-60dde63b77af None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:02.356705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:02.357824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:02.358868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:02.358868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.358868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:02.358868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 240/465] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:02.359146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.359494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.359699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.381594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:02.382782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:02.396452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.404733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63279fc8-ce2e-4701-9891-2f9ef6b9399a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.444489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.445295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.445575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.445884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.446539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.448173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.454014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.467833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 241/466] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:02.467833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.479914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 226/467] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:02 2022] POST /identity/v3/users => generated 246 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:39:02.481327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.667217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4155c159-02d0-4bc0-bb09-1870a64ccf91 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.697111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e940e51-44ca-436f-beac-968eb41958d7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.709955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.711124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.711479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.711853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.726145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.727992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.743071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.743692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.743997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.744272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.744924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:02.745221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-823bc497-4e6f-405e-a2db-e0a75eec52ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:02.745502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:02.746368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:02.747218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:02.747218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.747218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:02.747391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.747458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 227/468] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:02.747897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab95-b212-4cb1-b48a-f555a72700b0 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.748623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab95-b212-4cb1-b48a-f555a72700b0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.748623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6982ab95-b212-4cb1-b48a-f555a72700b0 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.750290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 228/469] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:02.751001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ab95-b212-4cb1-b48a-f555a72700b0 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.755668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.759790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 242/470] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:02.760618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.831953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:02.868722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6982ab95-b212-4cb1-b48a-f555a72700b0 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.879896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497bd74e-0ea3-468d-b558-2f36f6e8e4d4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:02.904592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.905217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.905497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.905752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.916046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.917534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.920332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:02.920990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.921272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.921650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.922830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:02.923180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:02.925083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-54d39fd9-7460-413f-8402-c464b0c8a458 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:02.931992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:02.932865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:02.933747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:02.933747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:02.933747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:02.933747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 229/471] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:02.934829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:02.934829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:02.935066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:02.941494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 243/472] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:02.942815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:02.956186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:02.958050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:03.012314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.031065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 230/473] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:03.031995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.058525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c2f83-c9bf-44ba-ab72-feb2cfcfd262 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.080279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.103532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.104279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.104655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.104995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.105714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.107214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:03.132582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 244/474] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:02 2022] POST /identity/v3/users => generated 248 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:03.133481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.148597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1468a943-7ee8-4671-a1f0-f42364aa2625 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.189481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.190551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.191118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.191579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.192606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:03.193378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.195083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:03.212778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 231/475] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:03.219996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.284838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.308662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fee52b-51f5-4ab3-a6bd-910815bccb00 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.350240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.350887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.351113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.351385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.352096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.353516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51d31e8-b663-4056-aaea-074b4929f952 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.353621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:03.378683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 245/476] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:03 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:03.379720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.418543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.419342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.419546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.419845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.420504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.424410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.426032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:03.466574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 232/477] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:03 2022] POST /identity/v3/users => generated 249 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:39:03.520398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d994ab-5f84-4f7d-8697-f043d58bc6df None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.570531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.571536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.572074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.572541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.573447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.575113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:03.586174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.sql.core [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 04:39:03.586174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 20 04:39:03.586174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [parameters: {'id': '6b0e7f9cf2bd42f1b4bf45c1485661cc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 20 04:39:03.586174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87787) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application result.read() Sep 20 04:39:03.604841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return ref.to_dict() Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:39:03.605828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application yield resource Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise self.value Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application session.commit() Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 04:39:03.606754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self.session.flush() Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application compat.raise_( Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 04:39:03.607646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:39:03.609217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application result.read() Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:39:03.611231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [parameters: {'id': '6b0e7f9cf2bd42f1b4bf45c1485661cc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:03.613355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 20 04:39:03.615357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:03.618966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 246/478] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 20 04:39:03 2022] POST /identity/v3/roles => generated 144 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:03.625100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.759588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88cbb94-af52-4a35-a106-5a325507fcfb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.761409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.802762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.803369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.803648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.803952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.815540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6704d14d-a35f-42e9-820a-66dd8a1b72a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:03.821007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:03.821899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:03.822714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 233/479] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:03.828941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:03.935457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:03.943487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf55404-70e6-470c-a7ed-13dd53d45843 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:03.988437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:03.989414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:03.989891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:03.990360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:03.991258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:03.991817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:03.993388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64282fcf-f083-4f96-a772-5f6f88368d6f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:04.003432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 247/480] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:05.079979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214727-b0d1-4f5e-aa77-df7c42827240 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.080525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214727-b0d1-4f5e-aa77-df7c42827240 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.080525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60214727-b0d1-4f5e-aa77-df7c42827240 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.082162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 234/481] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:05.087816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.088240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.088418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.109123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:05.110473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:05.199862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 248/482] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:05.467155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214727-b0d1-4f5e-aa77-df7c42827240 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:05.603363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60214727-b0d1-4f5e-aa77-df7c42827240 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:05.645875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:05.646858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.647141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.647413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.661106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-210a6b5b-720c-4c7b-8126-ee252db1c0a9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:05.665962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:05.666850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:05.667651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:05.671865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 235/483] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:05.674052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:05.788957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:05.808627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152b1296-66d0-4244-b607-6de4dd6924e1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:05.846152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:05.846765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.847042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.847313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.848099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:05.849879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2dab-d898-4aea-99ac-071579698198 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.850160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2dab-d898-4aea-99ac-071579698198 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.850429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3d2dab-d898-4aea-99ac-071579698198 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.851771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 236/484] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:05.851973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:05.853380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:05.864980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:05.865257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:05.865528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:05.867837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 249/485] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:05.869693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:05.903939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:05.905152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:05.942565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.033304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 237/486] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:06.047995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c62178-7863-4098-b73e-4c72ec98fc66 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.082939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.083577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.083891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.084162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.096126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:06.097631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:06.106488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:06.114547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:06.115458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:06.116475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:06.116475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:06.116475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:06.119840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 250/487] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:06.121816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.230685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e6e820-1c7c-4a52-ad95-5076e177b7c0 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.271103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.272031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.272312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.272584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.273314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:06.273621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:06.275201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e66ed01-2e4a-43b1-a55c-1a8c44a43237 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:06.293495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 238/488] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:06.299279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.414466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d90c-becd-4d5f-bbde-15452bb9c458 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.414810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d90c-becd-4d5f-bbde-15452bb9c458 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.415018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca76d90c-becd-4d5f-bbde-15452bb9c458 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.416592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 239/489] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:06.421093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c245c2-b08b-4763-a111-a4a960780518 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.421756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7157-0899-49bc-a389-a06114b5f3cc None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.422603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7157-0899-49bc-a389-a06114b5f3cc None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.422876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9b7157-0899-49bc-a389-a06114b5f3cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.455823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ba9b7157-0899-49bc-a389-a06114b5f3cc None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:06.457642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ba9b7157-0899-49bc-a389-a06114b5f3cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:06.465798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.471545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.472209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.472589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.472762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.481707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:06.483167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:06.497925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:06.498875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:06.500983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 251/490] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:06.501557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.534045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 240/491] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:39:06.535306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec62a9-ff31-49f3-9713-01330a2740f4 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.535588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec62a9-ff31-49f3-9713-01330a2740f4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.535890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ec62a9-ff31-49f3-9713-01330a2740f4 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.537229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 241/492] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:06.537773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec62a9-ff31-49f3-9713-01330a2740f4 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.578164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.632178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f816ccaf-59fd-41a4-9483-f1716d2f3577 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.677734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.678943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.679421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.679917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.681824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ec62a9-ff31-49f3-9713-01330a2740f4 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.694808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-bbfc57f8-08c1-49a5-999c-dc4b42be8717 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:06.704422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:06.705332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:06.706225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:06.709532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 252/493] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:06.711447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.712100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.712570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.725670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.726278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.726550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.726815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.727540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:06.727872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:06.729308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:06.735441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:06.736897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:06.769381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.772116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 242/494] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:06.783753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.809713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 253/495] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:06.810647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:06.878156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:06.894082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934b3283-f2ca-4057-83d1-4b90f9230682 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.930623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:06.931548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:06.932071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:06.932538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:06.933384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:06.933877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:06.935445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:06.943788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e071318-3a1d-494e-900e-c8309fb19775 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:06.945136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 243/496] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:06.946261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.002663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.003203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.003480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.003768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.016503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.062189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21d027-74fc-4c3a-97c5-fb97f25ea5d0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.095154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.096815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.098947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.099577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.099890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.100158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.111291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:07.116588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:07.117443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:07.118271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:07.122526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 244/497] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:07.123186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.153052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.204201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 254/498] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:07.205032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.227092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65735a20-4fe4-4442-8234-ae704a743c63 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.249097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.261501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.262125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.262426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.262694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.273942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.275395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:07.289180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:07.290106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:07.290984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:07.290984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.290984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:07.290984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 245/499] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:07.291199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.301479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4ad6bc-043e-4679-ae24-7bd1cd107cc0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.335089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.335712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.336015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.336284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.345983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-a025771c-3213-4744-8de6-ce5ca3dca967 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:07.350770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:07.351687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 255/500] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:07.357595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08429-7580-43b1-ac48-0c12ed155e43 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.358319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08429-7580-43b1-ac48-0c12ed155e43 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.358319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a08429-7580-43b1-ac48-0c12ed155e43 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.358319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 256/501] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:07.358319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a08429-7580-43b1-ac48-0c12ed155e43 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.370199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.393277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2b45d-402a-419e-9be9-65b2a8714e85 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.427063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710474-dae7-406f-98d4-470542889392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.427622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710474-dae7-406f-98d4-470542889392 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.427938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710474-dae7-406f-98d4-470542889392 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.428210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76710474-dae7-406f-98d4-470542889392 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.428865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710474-dae7-406f-98d4-470542889392 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:07.429164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710474-dae7-406f-98d4-470542889392 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.430524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76710474-dae7-406f-98d4-470542889392 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.438891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 246/502] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:07.439927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710474-dae7-406f-98d4-470542889392 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.470060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a08429-7580-43b1-ac48-0c12ed155e43 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.477066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.504584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.505204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.505480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.505750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.515428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.517449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:07.532260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:07.533235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:07.534077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:07.534077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.534077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:07.534077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 257/503] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:07.534077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.542410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76710474-dae7-406f-98d4-470542889392 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.576324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.576920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.577194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.577458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.578126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:07.578429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.579798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45edf41-f624-4fc6-9012-13ab5fb87fd6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.590928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 247/504] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:07.592100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.592437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.592694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.599875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.610520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:07.611715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:07.638316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694a1f20-f095-4c26-9740-e640a1e39bee None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.670698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.671303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.671583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.672395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.673047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:07.673348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.674708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.676763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 248/505] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:07.677468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.688765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 258/506] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:07.688765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.703220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.776916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7aa8bd7-4280-449f-8dd6-944f2da1b6cf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.793790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a98fd-f879-48ca-b0a4-c72935a84e9a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.812096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.812754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.813035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.813307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.818521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.824190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.826074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.831560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.832294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.832666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.833043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.834311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:07.834706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.836964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:07.841381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:07.842273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:07.843149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:07.843149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:07.843149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:07.843149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 249/507] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:07.843366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.854711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 259/508] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:07.855597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:07.930477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:07.953401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba0bfa3-ec00-4d26-99da-1c33ee1d4148 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.959148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b79449-44c4-4e16-881a-556c5ca7e658 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:07.987222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.987865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.988140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.988412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] PATH_INFO: `/v3/users/glance` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.993178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:07.993791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:07.994071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:07.994346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:07.995675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:07.997142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.004078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.005504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:08.009176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.010249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:08.011159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 250/509] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.011771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:08.021843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.023052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:08.024406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:08.024406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:08.024406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:08.024406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 260/510] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.024406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.063181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.114176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368b58ba-9024-417c-b2fc-124cc4773a4d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.126565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6bcff6-7750-4bac-9b13-25a132ed4ce8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.148324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.148924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.149203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.149482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.150121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.150420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.151808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.158648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.159504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.160274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.160611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.160920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.164195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 251/511] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.165079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.173025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.174473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:08.187484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.188938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 261/512] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.194894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.267641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb114655-9e15-4036-8c1a-64f766d9ff5b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.281000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.288958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1708f74-b47b-45e4-a2ba-dccd0bb5221b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.305487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.306327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.306718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.307109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.319661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.321396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.323503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.324132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.324409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.324677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.325398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.325703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.327125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:08.338846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.339812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:08.340717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:08.340717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:08.340717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:08.340717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 252/513] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.340947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.364996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 262/514] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.365836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.396445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.447529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74bb3ad4-1699-4398-9221-230380db654e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.465350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50ab685-83a6-48f3-9b59-0d2e818c0c58 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.480721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.481316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.481589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.481854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.482485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.482780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.484165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.495287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 253/515] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.496096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.504784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.505413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.506048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.506325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.513636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.515083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:08.527154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.528163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:08.529069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 263/516] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/users/neutron => generated 85 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.529632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.547377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.596762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242d6429-b868-404b-92f2-fbb954283908 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.606921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.632580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac7f47-0a4b-47d2-81d1-dd601bd16b31 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.633428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.634025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.634301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.634847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.635529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.635856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.637284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.658572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 254/517] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.659389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.666587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.667192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.667469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.667752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.668404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.668706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.670074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.681582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 264/518] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.682373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.756885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.757132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed502940-f594-47f8-9157-61b4b523fe52 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.782072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a048280-2a44-462f-9f71-42345f69269e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.790194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.790979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.791261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.791533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.815777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.816392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.816668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.816934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.823691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.825141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.830062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:08.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:08.837436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 265/519] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/users/cinder => generated 84 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:08.838364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.862440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.863920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.936835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c541a4-7d6e-40e7-9f9b-a41c3f2bccdb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:08.959099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 255/520] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:08.959952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:08.969548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:08.970151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:08.970435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:08.970710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:08.971437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:08.971752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:08.973181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:08.974766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:08.992322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 266/521] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:08.993086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.031640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.061629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cbd469-481e-48f5-b2ab-5518704ea1d7 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.090708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6c49b4-bc42-4284-b1cb-c28b06a2dc9b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.095451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.096145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.096422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.096693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.097413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:09.097715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.099132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.104523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 256/522] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:08 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:09.105074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.134409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.135662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.135977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.136251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.136951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.138400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.167772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 267/523] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:08 2022] POST /identity/v3/users => generated 247 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:09.167772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.232209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585bc9e-4b73-4ca7-8a2e-762da2b83f9b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.233476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.282753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.283194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.283474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.283778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.284565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:09.284809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.286277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.289376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.310459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 257/524] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:09.311506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.316477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1946054f-808a-4ab8-bce2-c1649f5310cd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.395909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.397090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.398321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.398807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.412713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.414667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:09.431525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:09.432542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:09.433470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:09.433470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:09.433470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:09.433731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 268/525] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:09.434472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.498482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abca8fd-a7d4-4d0d-b7e8-dd848a616047 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.544166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.544695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.545505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.545779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.578187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.581891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a0ea70-176d-4167-a269-d07b6f95d094 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.621134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.627238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.628498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.629001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.629946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.631637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.633489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.709598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.711521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:09.751053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 258/526] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:09.751975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.816172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.821365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 269/527] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:09.822455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:09.887532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:09.906299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bcb0fc-9a5f-4b3b-8e36-b91566723778 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.961040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1f845b-8eb8-4d51-a318-458dfebdc8ce None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:09.961770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:09.962816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:09.963493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:09.964897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:09.966920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:09.967440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:09.969100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.004576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 259/528] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:10.004576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.035988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.037987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.038675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.040703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.062459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.064646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:10.097786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:10.098752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:10.099616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:10.099616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:10.099616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:10.099616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 270/529] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:10.104673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.176543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94758eb4-71c6-47c7-b174-bf1250077073 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.190006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.215852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.216878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.217356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.217823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.229935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.231840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.241505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52ef092-741b-4ad4-860d-922003d083ac None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:10.248435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:10.249771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:10.251160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:10.251160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:10.251160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:10.253314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 260/530] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:10.259493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.264004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.282873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.283836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.284285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.284694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.293386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.295041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:10.313774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:10.314851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.315950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:10.317997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 271/531] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:10.318904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.386830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72bb0c6-7c4c-4a13-9aff-94dc98ad1779 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.436004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.436977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.437590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.438009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.438887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:10.439401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.441110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.455512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df83e014-1416-4087-8492-d2678aa5fddd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.457893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 261/532] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:10.458953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.471847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.494692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.495753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.496299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.496767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.497595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:10.498108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.500549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.517611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 272/533] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:10.518828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.533130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.574653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa53425-909b-4887-aca3-5f60a249f1c1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.613508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.614123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.614465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.614668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.615473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:10.615802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.617481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.634939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 262/534] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:10.635888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.636923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ff3723-5c04-4402-bead-1a4c753af2d6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.674694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.675785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.676282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.676749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.683933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.685652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:10.697632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:10.698485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.699352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:10.701798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 273/535] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:10.702843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.740643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.754128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d3efdc-34cc-4642-a8b5-ce5c89e71296 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.778895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:10.794604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.795639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.796033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.796317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.803812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.805263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:10.817795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:10.818697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:10.819539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:10.824014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 263/536] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:10.824387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b626cd9-4de3-414d-94ae-96bcab99781d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:10.824858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:10.866132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:10.867573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:10.868057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:10.868499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:10.869841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=c71d74618fe94bddab05e457aaab72ff) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:10.870715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:10.872620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:10.879760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 274/537] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/role_assignments?user.id=c71d74618fe94bddab05e457aaab72ff&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:10.880737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:11.001307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b1dbe6-b719-4f03-80df-f811dc82f970 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:11.059788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:11.060416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.060693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.060963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.061664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:11.061966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:11.064064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:11.079715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:11.093426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b02d91-822a-4074-a7bd-283ae6b8872b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:11.105215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 264/538] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:11.111382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:11.142816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:11.143433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.143702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.144006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.144702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:11.145107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:11.146789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:11.166076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 275/539] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:11.169418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:11.172535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:11.232285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fcae5-72c1-4721-a9c6-1ca405a6b92c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:11.278201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:11.279685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.280207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.280680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.282646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=fff72313d3f14d8abbe9db7bf6e0501b) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:11.283310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:11.285312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f217744-58ac-40b8-823a-fa3da703bd77 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:11.292981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 265/540] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:11 2022] GET /identity/v3/role_assignments?user.id=fff72313d3f14d8abbe9db7bf6e0501b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:11.351673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef276c9-20cc-490d-af23-837f555775ff None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:11.403536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:11.404189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.404463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.404731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.405574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=4601933cc2c047a8920d7450c0ee4f56) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:11.405885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:11.407985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d825509-2739-4eb7-b99d-99f0d9bef80b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:11.414217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 276/541] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:11 2022] GET /identity/v3/role_assignments?user.id=4601933cc2c047a8920d7450c0ee4f56&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:11.450993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06fd-da4c-423a-91b7-7a111df6f7fb None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.451688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06fd-da4c-423a-91b7-7a111df6f7fb None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.452227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647e06fd-da4c-423a-91b7-7a111df6f7fb None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.454993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 266/542] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:11.460685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dd6cf-aa94-4318-bde6-15474ca88cd3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.460996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dd6cf-aa94-4318-bde6-15474ca88cd3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.461236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b7dd6cf-aa94-4318-bde6-15474ca88cd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.494855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1b7dd6cf-aa94-4318-bde6-15474ca88cd3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:11.495226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1b7dd6cf-aa94-4318-bde6-15474ca88cd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:11.511816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:11.572796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 277/543] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 20 04:39:11.586150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd689c8-0f0b-45ff-9d66-f1cd7464a793 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.586761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd689c8-0f0b-45ff-9d66-f1cd7464a793 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.587239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd689c8-0f0b-45ff-9d66-f1cd7464a793 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.589158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 267/544] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:11.594721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:11.594996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:11.595269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:11.614875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:11.616108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:11.688354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 278/545] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:11.973651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd689c8-0f0b-45ff-9d66-f1cd7464a793 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:11.994288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.143089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:12.148491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd689c8-0f0b-45ff-9d66-f1cd7464a793 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.167382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:12.180772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4025fc7-5b94-4067-aab2-cf2436afd864 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.212515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.213616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.214225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.217249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.234971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:12.240281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:12.241177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:12.241998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:12.244575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 268/546] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:12.253755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.253755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.253755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.253755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.254885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.275185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:12.279961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:12.280844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:12.282188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:12.284041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 279/547] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:12.292962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.458281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca85b96-ae58-4939-bb25-9e8cc6f6230d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.473301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8077e218-0b7d-49b3-9a11-768831126d0f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.528392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.528919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.529198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.529464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.530123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:12.530420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:12.531855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:12.539679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.540303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.540578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.540847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.541510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:12.541810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:12.543155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:12.550790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 269/548] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:12.553848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.564399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 280/549] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:12.565277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.570714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:12.606714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:12.686199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66879165-02ea-438d-b8a5-d7f98c69f8dc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.724657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.725286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.725563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.725835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.737764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:12.739264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:12.755815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:12.757946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:12.759347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:12.759347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:12.759347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:12.759347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 270/550] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:12.764536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.806091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f0c9cd-02e4-40c7-8812-ee147331238d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.877157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:12.877798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:12.878075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:12.878348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:12.895870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:12.897583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:12.915069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:12.916086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:12.917572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:12.917572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:12.917572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:12.917572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 281/551] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:12.928820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:12.936939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:12.967665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be70b82f-b7db-48a3-bc8b-bd1a1f64d1f9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:12.988705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.037793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1d30f92-ab22-48a7-873a-9ae4782d6005 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.039099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.039784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.040012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.040291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.040977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:13.041278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.042686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.062276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 271/552] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:13.067492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.108457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.109105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.109947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.110225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.110876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:13.111177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.112577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.133651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 282/553] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:13.140604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.183366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd88806-fad4-423e-909d-f718b724bb97 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.220803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.221533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.221817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.222190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.229649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.231097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:13.244652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:13.245717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:13.246653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 272/554] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/users/swift => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:13.252743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.259079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.326467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594af2ce-ddb3-4c28-81a3-48d73246edbb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.356422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.397920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.398614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.398892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.399161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.412422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.413692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f5203d-658b-4201-9fff-66950bd7a882 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.413903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:13.436981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:13.438649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 283/555] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:13.446546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.483529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.484770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.485037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.485268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.486007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:13.486307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.487782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.542883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 273/556] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:13.543969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.628554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.639230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6912c68-8157-4e9a-9d4b-0c8423bee264 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.674245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e62307-f6f1-45d8-aed5-da22c34d9b8c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.685511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.686513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.686796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.687068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.688172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:13.688484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.690215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6408f632-1b7e-4583-818e-189d5a39bc1f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.712126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.713102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.713431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 284/557] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:13.713897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.714404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.714637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a815-7ae0-4d8c-97b0-2a5a22d128d9 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.714917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a815-7ae0-4d8c-97b0-2a5a22d128d9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.715187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd95a815-7ae0-4d8c-97b0-2a5a22d128d9 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.720829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 285/558] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:13.722686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a815-7ae0-4d8c-97b0-2a5a22d128d9 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:13.765368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.792397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.794194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005ba2b5-1000-4c6b-9e50-beb62a199c77 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.868290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:13.874358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd95a815-7ae0-4d8c-97b0-2a5a22d128d9 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:13.920270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 274/559] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:13.922392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d911b-89c8-49a7-be6e-844bde203971 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.922883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d911b-89c8-49a7-be6e-844bde203971 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.923358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724d911b-89c8-49a7-be6e-844bde203971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.927720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:13.928385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:13.928701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:13.928972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:13.942171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:13.943620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:13.945594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-724d911b-89c8-49a7-be6e-844bde203971 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:13.946825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-724d911b-89c8-49a7-be6e-844bde203971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:13.958568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:13.959531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:13.960491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:13.960491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:13.960491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:13.960491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 286/560] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:13.960810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.012172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 275/561] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cdff-1163-44ad-999e-7d07b0b849dd None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cdff-1163-44ad-999e-7d07b0b849dd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e3cdff-1163-44ad-999e-7d07b0b849dd None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 276/562] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9431c1-8c52-4644-8a2b-7939dc0cd81b None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.019967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9431c1-8c52-4644-8a2b-7939dc0cd81b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.020354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9431c1-8c52-4644-8a2b-7939dc0cd81b None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.020354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 277/563] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:14.020354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9431c1-8c52-4644-8a2b-7939dc0cd81b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.050760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.069220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cecebe7-bfce-4f06-8835-49acec260e6e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.108478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.109107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.109500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.110302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.116527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.121780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.123227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.128754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9431c1-8c52-4644-8a2b-7939dc0cd81b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-fb418158-5a35-401e-8a5d-c3e58d0861ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:14.137207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.138188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:14.139142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:14.139142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:14.139142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:14.139142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 287/564] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.140085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.140085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.140085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.158070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:14.159268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:14.170170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.171100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.171582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.172628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.173572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:14.174126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.175676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2bd095-e53a-4d72-b52d-522b5f021692 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.188470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 278/565] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:14.189832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.190299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.190774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.210591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:14.212156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:14.230014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 288/566] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:14.230850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.297377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 279/567] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:14.298514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.310162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.353248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23b0cb-3268-4a5f-8872-878db45a251f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.401138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.402084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.402363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.402909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.403562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:14.403891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.405805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.420070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.420215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 289/568] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:14.421057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.435905 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff3a8e-70e3-4d52-b181-8b32b5371f7b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.481851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.482484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.482762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.483088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.490760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.492358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:14.505489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.506578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:14.507569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 280/569] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.508109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.539116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40a4f3a-89ed-4a28-962e-783256a46c06 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.566564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.577784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.579020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.579285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.580090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.590785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:14.596114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.597034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:14.597893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 290/570] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.598589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.620358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-749e91de-a115-499e-ad6e-8146b0a28019 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.654369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.654995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.655274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.655543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.662087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.663525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.666004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:14.675789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.676859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:14.678037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 281/571] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.679520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.701345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a5abc5-77c3-4f45-9e38-88e163441724 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.735569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.736199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.736472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.736746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.737429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:14.737729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.739141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.751038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 291/572] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:14.751845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.780905 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff828344-812e-4a88-8b52-524f1893eeea None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.798008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.814602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.815226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.815503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.815797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.825956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:14.831766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.832717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 282/573] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.833573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.853875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5489afdf-de8c-42b2-82b8-3ffeba5d128b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.889132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.889747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.890018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.890282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.890883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:14.901962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:14.907223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:14.908196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:14.909045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 292/574] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:14.910096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:14.938375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6f5707-7f3c-4944-8da7-a3de0395fe5b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:14.974567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:14.975176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:14.975454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:14.975722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:14.976410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:14.976710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:14.978070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:14.986254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 283/575] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:14.987012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.013486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946a073e-1a3d-44d5-89a6-005f0f8860f2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.020490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.047918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.048513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.048785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.049052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.049727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.050024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.051429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.063414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 293/576] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.064222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.084954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8b1bb-6f31-45d9-8ed3-ae6f9028c0d7 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.107362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.118824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.119476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.119784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.120060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.134017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=697f2e9daa334a068f10a5ba0671aed6, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.135439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.148798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 284/577] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:14 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:15.149585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.166432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282a406f-9fe2-4bd0-960f-0aecac972b37 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.210565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.211672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.212239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.212752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.213570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.214013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.215527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.226338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 294/578] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.227124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.261346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.279503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622948f9-bcbb-4fb9-8559-ac1a86a1f5a8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.318742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.319651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.320123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.320550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.321220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.321523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.322889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.332522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 285/579] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.333357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.348415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b85be3-f481-4f04-936c-930319618af6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.378614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.383441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.384099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.384372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.384636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.395673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.397555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:15.412159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:15.413323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:15.414510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:15.414510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.414510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:15.414510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 295/580] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:15.414510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.466234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88458a59-a8c6-4cc5-ae53-747f8acaf12b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.501444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.503657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.504328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.504555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.504844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.505522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=be18420a973d4c8ab00a488d465cdd03) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.505822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.507233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.523467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 286/581] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/role_assignments?user.id=be18420a973d4c8ab00a488d465cdd03&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.523467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.536295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9c8cd2-f24d-453c-85be-02d4f36b4b62 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.579701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.580471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.580815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.581152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.595966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.598534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:15.616983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:15.618021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:15.619203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:15.619203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.619203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:15.619203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 296/582] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:15.620472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.641767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7009f02-f481-4aea-b359-dfc7e6e07ee3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.643772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.681053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.681850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.682224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.682588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.695713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.697399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:15.713360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:15.714401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:15.715314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:15.715314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:15.715314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:15.719659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 287/583] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:15.720605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.746823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-958bdbcc-c616-4141-834d-14b6a95d9292 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.782917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.790124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.790595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.790877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.791150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.791876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.792179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.793782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.813775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 297/584] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.813775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.850959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8e1c27-a88c-4259-9375-63a0ae325755 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.886789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.887552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.887984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.888348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.889093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.889494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.891104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.904235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 288/585] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.908731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:15.929097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5698c4a6-33f7-4b82-8f7a-68ca3e5f4f5a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:15.936134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:15.969975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:15.970732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:15.971217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:15.971961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:15.972408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:15.972806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:15.974269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:15.991893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 298/586] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:15.991893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.049837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e962671-4239-414b-8290-8b41d1d06c57 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.065300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.090003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.091248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.091754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.092228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] PATH_INFO: `/v3/users/glance` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.100776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.102507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:16.114864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.116123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:16.117114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:16.119440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 289/587] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/users/glance => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.120493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.127088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183fe24b-b7aa-4fae-aab0-81f5aae57dbd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.166269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.166896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.167451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.167561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.176744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.178377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:16.191444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.192471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 299/588] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:15 2022] GET /identity/v3/users/cinder => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.198896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.202275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.240937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b592bb7-debe-4b3f-934d-d6ab00f3265a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.287761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.288755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.289277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.289770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.299057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.301111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:16.313301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.314269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:16.315216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:16.317741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 290/589] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.318733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.326893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc702bbf-c051-4205-8a8a-b369581bcd5b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.343208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.369302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.370059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.370459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.370740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.371465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:16.371800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.373377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.395250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 300/590] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:16.400671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.440385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08afd3fc-0371-4ef2-a896-9597217d45b2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.475706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.483493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.484988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.485470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.485937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.486915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:16.487418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.489097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.514439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 291/591] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:16.514439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.533945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db71f9fe-3435-4e2f-b89b-b8efdfcae17a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.578707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.580086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.580625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.581105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.582544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:16.583186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.585189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.606154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 301/592] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:16.607331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.638032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c9eb35-b34c-4dd5-b404-18d05fcacfed None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.642019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.673110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.673739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.674012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.674281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.684624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.686052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:16.701428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.702457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:16.703998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:16.703998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.703998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:16.707955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 292/593] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.708806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.733752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed9f40d-c89f-4913-aa13-51d339803df2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.751700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.778609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.779956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.780707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.782596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.795670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.798697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.813711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370196f-e6ef-4c8c-b9b8-12fa66e7c70b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:16.818348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.819484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:16.820653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:16.820653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.820653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:16.827199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 302/594] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.827199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.854519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:16.855071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:16.855346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:16.855617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:16.866445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:16.867902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:16.883041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:16.884081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:16.885362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:16.885362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:16.885362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:16.885362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 293/595] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:16.885362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:16.934109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.959515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283dda1e-efed-493e-80f0-858749b5c61d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:16.987695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:16.997464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f225cf1e-2533-4dcf-95e9-baf3cd47046b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.003092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.004069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.004580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.005136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.006095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.006601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.008340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.024318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 303/596] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.025501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.040562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.041018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.041293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.041562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.042279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.042501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.043946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.060710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 294/597] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.060710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.157710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cdb18ad-b625-4dd8-b38d-2f9dd8c28f99 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.164588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0593a2-f0b0-4fcc-b054-9ef8dc35877e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.197228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.197847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.198136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.198371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.199009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.199304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.200845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.210855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.212855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.213814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.214860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.214860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.215035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 304/598] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.220577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.227446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.229232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:17.246125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:17.247160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.248126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:17.251831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 295/599] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:17.253174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.281777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54849094-8f8c-4c36-b638-26a7cae55724 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.387690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7753409-80c9-481f-b094-3555fe33f925 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.390183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.391429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.391796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.392141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.399500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.400969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:17.418861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:17.419968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:17.421071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 305/600] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:17.421693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.426682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.427623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.432577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.432971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.440972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.442584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-7d826283-582d-4c36-ab62-d07c56d54768 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:17.454574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:17.455493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:17.456834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 296/601] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:17.457333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8b65-cb84-4824-98b4-9a549fc01e60 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.457404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8b65-cb84-4824-98b4-9a549fc01e60 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.457768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eb8b65-cb84-4824-98b4-9a549fc01e60 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.458980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 297/602] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:17.459538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8b65-cb84-4824-98b4-9a549fc01e60 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.490275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.535646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e852379-3064-42bb-ad5c-dedcc76a1f72 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.543527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.572454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.573207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.573581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.573986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.574773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.575044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eb8b65-cb84-4824-98b4-9a549fc01e60 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.575281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.576828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.594456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 306/603] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.594456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.615502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.616209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.616555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.616900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.617640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.617942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.619464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a43dfb-db73-4d51-aad8-46fe2a7d43ca None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.636840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 298/604] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.639169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.639574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.639992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.661029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:17.662507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:17.708051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-850fb8d9-5bd1-402c-a5bc-cc45173279f0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.733311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.734330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 299/605] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:17.735515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.749998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.750833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.751269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.751717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.752638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:17.753083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.754757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.767127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 307/606] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:17.768104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.814644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:17.855805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268ff3c7-49db-492a-a89d-85a473975fa6 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.875033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffc9d95-5a5b-4232-b6c3-d8eeffcaccec None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:17.890839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.891495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.891788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.892057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/c71d74618fe94bddab05e457aaab72ff/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.907935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=c71d74618fe94bddab05e457aaab72ff, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.909358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4affda1a-7849-40b1-81b2-44375dac2d45 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.910339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:17.911092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.911465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.911862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/4601933cc2c047a8920d7450c0ee4f56/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 300/607] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:17 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/c71d74618fe94bddab05e457aaab72ff/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463946-b972-4338-a8fb-1e2bdd62c086 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463946-b972-4338-a8fb-1e2bdd62c086 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17463946-b972-4338-a8fb-1e2bdd62c086 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 301/608] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:17.930101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17463946-b972-4338-a8fb-1e2bdd62c086 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:17.939985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=4601933cc2c047a8920d7450c0ee4f56, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:17.941796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e90486fa-7951-4b77-bc4c-fb93893a331d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:17.961223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 308/609] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:17 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/4601933cc2c047a8920d7450c0ee4f56/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:17.962900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:17.963283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:17.963679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:17.985287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:17.986731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:18.029213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.083079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 309/610] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:18.084404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.121310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17463946-b972-4338-a8fb-1e2bdd62c086 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.143803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.179763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.180482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.180813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.181088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/fff72313d3f14d8abbe9db7bf6e0501b/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.198542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=fff72313d3f14d8abbe9db7bf6e0501b, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:18.200069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:18.204462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b503b61-cda8-4705-9ff0-97fc943ea9b2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.223966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 302/611] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:17 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/fff72313d3f14d8abbe9db7bf6e0501b/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 293 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:18.251788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.252531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.252872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.253205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.266652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:18.272338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:18.273558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:18.274592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:18.275396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 310/612] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:18.282392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.400562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31af9124-3243-4fe7-9f57-03f859b78a7e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.451272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.452001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.452344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.452681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.454102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:18.454473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:18.455962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:18.464985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 303/613] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:18.471392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.487538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.498739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.520928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.617416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b88c2-0351-4b96-ad4e-7be02cb56ecc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.625724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832e3a55-611c-4039-b7af-33927dab8460 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.693433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.694354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.695185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.696018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.696139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.696528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.696715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.697114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.708371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:18.714056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:18.714998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:18.715914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 304/614] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:18.722504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:18.724247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:18.724651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:18.740646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:18.741629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:18.742550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:18.742550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:18.742550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:18.744711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 311/615] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:18.751084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.825993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.860903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f532095-00c1-4353-a2c1-f6deed070802 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.897801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:18.899137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:18.899616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:18.900091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:18.900916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:18.901395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:18.902268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:18.904371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:18.928312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 312/616] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:18.932457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c255ea-5472-49eb-990e-1d8171b3ac58 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:18.934840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:18.998658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.001172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.001657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.005476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.006429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:19.006912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.008533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.027336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 305/617] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:19.035782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.082392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdfc148-f387-48a5-8a71-030af017e8e4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.116199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:19.122931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.123907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.124359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.125426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.133252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.134999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:19.148497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:19.149498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:19.150535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:19.152908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 313/618] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:19.158160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.234314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda18e64-4f91-4bfb-9300-cf3545c38bd0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.304414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.305283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.305701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.306108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.328155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.330882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.344881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:19.355251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9b3442-92f8-499f-96df-a36474ed413c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:19.363762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:19.364894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:19.365807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:19.365807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:19.365807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:19.365807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 306/619] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:19.367644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.424194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.424887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.425167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.425440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.426168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:19.426472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.427912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.462392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 314/620] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:19.467828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.552711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:19.570386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48c1950d-5319-419d-a1f6-19ae6504fe4a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.628351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.629014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.629249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.630204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.630849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:19.631147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.632534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.639742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ad2859-1ddd-4c66-a0f4-b2da84b02659 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.659480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 307/621] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:19.665499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.698214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.698834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.699109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.699377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:19.822247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.823601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.827062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69671ace-f5bc-4122-a3d7-a875ab1b43d6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:19.889034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:19.889667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:19.889941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:19.890217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:19.903310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:19.904762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:19.916077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:19.924283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:19.925411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:19.926364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:19.927509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 308/622] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:19.932178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:19.979789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 315/623] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:19.983491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.125661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e994c5b-41f6-4bef-859d-bbd63f77b961 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.159376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.176020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6f71b7-cb2c-4f9a-a0d7-99ae433069ef None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.203493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.204963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.205820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.206637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.208363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:20.209223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.211592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.246915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 309/624] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:20.251081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.277480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.278130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.278408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.278946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.300932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.302389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:20.334751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:20.336044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:20.337218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:20.337218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:20.337218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:20.340027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 316/625] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:20.346335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.352045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.432897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae210ce6-bdb3-4f4b-bf35-3dbd865d3aa9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.468033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a79fe-0522-4ce9-976f-bdf3f287d420 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.507747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.507956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.508388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.508513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.508670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.508778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.508934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.509027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.509574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:20.509882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.511266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.524750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 317/626] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:20.528922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.531589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.532406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-9ffa75b2-ed50-4360-afb1-5e37b11abe20 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:20.566925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:20.568131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:20.569129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:20.569129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:20.569129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:20.569129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 310/627] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:20.569428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86c00-78a6-4ff3-a3f5-e03f861bfc81 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.569523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86c00-78a6-4ff3-a3f5-e03f861bfc81 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.571140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f86c00-78a6-4ff3-a3f5-e03f861bfc81 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.571140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 311/628] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:20 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:20.575582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f86c00-78a6-4ff3-a3f5-e03f861bfc81 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.617348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.626668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.678492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d56437-dce7-4ba0-b26f-05de104f5acc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.729594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.730334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.730670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.731015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.732716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f86c00-78a6-4ff3-a3f5-e03f861bfc81 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.740588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.742130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-48881f9a-13c5-44c9-b653-640bcdcf612a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:20.758362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:20.759327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:20.760586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 318/629] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:20.761291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.761509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.761776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.774321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.774938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.775216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.775486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.776188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:20.776492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.777869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864c3e68-11d1-4f6a-bcbf-0e7418bd1b8d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.782203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:20.783380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:20.792177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 312/630] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:20.792177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbda8b-941f-4e59-bae1-f24a08b6c071 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.792177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbda8b-941f-4e59-bae1-f24a08b6c071 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.792177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccbda8b-941f-4e59-bae1-f24a08b6c071 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.792909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 313/631] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:20.793604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbda8b-941f-4e59-bae1-f24a08b6c071 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.855181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 319/632] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:20.856140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:20.885645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.900850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccbda8b-941f-4e59-bae1-f24a08b6c071 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.911982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:20.937119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:20.938596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.938871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.939139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.939871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:20.940171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:20.941589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7d6ed-eacb-4db1-868b-714e0f7dc6ff None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:20.952698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 314/633] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:20.953873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:20.954153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:20.954423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:20.969625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2285037-bc03-43e0-94ae-d1390b723500 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:20.971678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:20.972878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:21.007978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.008530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.008805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.009069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.015642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.017112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-8a1f0959-1aa8-4dc4-aef1-c687d727fd88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:21.028301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:21.029202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:21.030148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 320/634] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:21.030672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18a8c-7772-41e3-95e6-5686182685b3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.030751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18a8c-7772-41e3-95e6-5686182685b3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.031464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a18a8c-7772-41e3-95e6-5686182685b3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.035944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 321/635] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:21.035944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18a8c-7772-41e3-95e6-5686182685b3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.049182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 315/636] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:21.050316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.150012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.160187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a18a8c-7772-41e3-95e6-5686182685b3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.173296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f74961-dd9a-4e98-bd7b-2db9109ef76d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.173651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.196844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.197447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.197727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.197996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.198721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:21.199027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.200620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6851a92-b24b-4026-a481-fd45aedadddf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.207460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 322/637] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:21.215985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.215985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.215985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.217837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.218491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.218808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.219080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.219913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:21.220222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.221840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.240806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 316/638] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:21.240806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.243636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:21.245209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:21.348092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 323/639] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:21.349344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.370791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6329361-d8be-4155-aa72-c7eec5e508b2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.417006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.417211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.417828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.417828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.428499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.436762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:21.443768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:21.444822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.445699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:21.448510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 317/640] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:21.449464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.486818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16ec32-f9f8-469b-a6f7-d05c7638404c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.496178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.530364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.531850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.532136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.532413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/be18420a973d4c8ab00a488d465cdd03/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.552722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=be18420a973d4c8ab00a488d465cdd03, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.554155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.575807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 324/641] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:21 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/be18420a973d4c8ab00a488d465cdd03/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:21.577089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.602782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89330b13-dc53-4cf4-8366-9f2e700a8810 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.659939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.660639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.661184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.661469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.681977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:21.690606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:21.691865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.692850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:21.697743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 318/642] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:21.698755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.711046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409ac40d-51f0-4bc5-9a32-ed98537e6311 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.749217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.750432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.750756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.751032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.751717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:21.752035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.753425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.767865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 325/643] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:21.768875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.781398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.791120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:21.842781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3602ef16-25dd-436e-b847-cc5f9a8ec43d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.881382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e893fe8-5f0f-4178-8d0f-4d8517f3b068 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:21.887867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.889248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.889699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.890116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.904629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:21.914393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:21.915625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:21.916750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:21.919065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 319/644] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:21.919211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:21.919927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:21.920266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:21.920562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:21.920683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:21.921424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:21.922360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:21.923858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:21.932846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 326/645] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:21.933740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.032870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.055681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fbb759-4420-499d-a892-9795c7699876 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.059439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bcaf4f1-b3ad-4add-bbfe-35c4aa8cf898 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.078547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.102125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.102855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.102981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.103291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.103632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.104069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.104490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.104925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.105991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:22.106438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.108776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.116249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.118691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.121450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 327/646] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:22.122674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:22.140350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.141897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:22.142898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:22.142898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.142898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:22.145033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 320/647] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.146099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.248873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1a5aa4-05a1-4207-b88e-dc9d8b16b89a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.251637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff06cbf-19c1-4f11-99f7-dc2b2f358fdb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.292838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.293831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.294288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.294737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.296332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.297766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.298055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.298320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.312549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.313990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.315359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.316824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.317231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:22.332505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.333535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:22.334458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:22.334458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.334458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:22.334458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 321/648] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.335273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:22.340594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.341550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:22.342453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:22.342453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:22.342453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:22.345375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 328/649] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.346895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.361646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.456672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d79715-de7e-4cf8-8923-d016573c8766 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.471590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270280fd-a08f-4cda-b85f-255e5ceac107 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.499884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.500961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.501742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.502491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.503467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:22.504020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.506189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.509228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.509811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.510093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.510364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.511006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:22.511306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.512760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.522226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 322/650] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:22.523308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.532165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 329/651] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:22.533022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.604111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.635184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.656378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cc4e4f-cced-4e43-ad1f-06ebab191ee5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.656672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26561ccf-cb81-4e56-8190-1b5a5c086e47 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.694156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.695224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.695506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.696064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.696785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:22.697020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.698388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.700093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.701255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.701627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.701991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.710654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.712235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.715767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 323/652] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:22.717266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:22.726486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.727496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 20 04:39:22.728594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:22.732259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 330/653] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/users/glance => generated 84 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.733511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.828444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dffc223-b3f3-4b4f-a29d-dc53e101d1ba None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.845465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4226f90f-6b8d-492d-9332-dedf403ee5e3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:22.861408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:22.869098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.869802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.870138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.870473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.882005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.883598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.885789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:22.887173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:22.887637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:22.888117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:22.896763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:22.896917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.897830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:22.898792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 324/654] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.899404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:22.899477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:22.910599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:22.911598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 20 04:39:22.912617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:22.916266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 331/655] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:22.917103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:22.920069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.019000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f587a3c-2ae7-467d-8033-fb4662081c43 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.039796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4651adcc-0fa6-474b-bd33-693411510419 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.059968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.060871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.061224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.061855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.063218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:23.063599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.065146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.082587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.083897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.084325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.085034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.085927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:23.086374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.091757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 325/656] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:23.091757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.093727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.115329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 332/657] 10.222.0.42 () {56 vars in 1137 bytes} [Tue Sep 20 04:39:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:23.116497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.154812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.176153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.224937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef924902-791d-4b05-84ee-6db17e52a905 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.243528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1a6792-5515-48f9-a138-64c4c712fde1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.271212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.272609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.272988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.273493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.274504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:23.275152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.277437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.285236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.286298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.286745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.287168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.300096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 326/658] 10.222.0.42 () {56 vars in 1139 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:23.304538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.368752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.370429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.411755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.447105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ad2ec4-7293-44df-b932-187a18d8a4c4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.469619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.498972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.500900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.501433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.502334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.510083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 333/659] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:23.510083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.602695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.605059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.613653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb93cc8-0b68-4a20-b33c-b0fdecab79a5 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.646967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.653038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.654119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.654516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.654787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.706368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 327/660] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:23.707550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.728332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.739762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.741430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdd7b82-f695-4dc6-a587-44f44f0fa5d3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.819909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9d252d-6ec8-4c2b-a506-2e617de65652 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.849487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 334/661] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:23.850746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090257-4324-4819-8131-7bcd845fe2ce None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.851027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090257-4324-4819-8131-7bcd845fe2ce None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.851294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83090257-4324-4819-8131-7bcd845fe2ce None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.852763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 335/662] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:23.857309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090257-4324-4819-8131-7bcd845fe2ce None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.860359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:23.861003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:23.861283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:23.861553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:23.872117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:23.874114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:23.889927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:23.891551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:23.892503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:23.892503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:23.892503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:23.892503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 328/663] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:23.892503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:23.894588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.965974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83090257-4324-4819-8131-7bcd845fe2ce None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:23.969235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:23.999684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.000913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.001086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc16c6f-59ca-46a1-8e26-edc153d38703 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.001187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.001453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.012480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.013925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f0e2b174-d6ec-40db-8d66-d52bbc4382d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:24.029185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.030315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:24.031471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:24.031471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:24.031471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:24.031471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 336/664] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.031471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.031869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.032005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.038710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.039342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.039621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.039997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.049683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:24.050879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:24.050987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.052410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-067373a4-0095-4621-990d-3e54bda0734b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:24.066741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.067707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:24.068629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:24.068629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:24.068629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:24.068629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 329/665] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.069031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78b98-ce78-4ab0-968a-8b22ab8fa813 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.069298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78b98-ce78-4ab0-968a-8b22ab8fa813 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.069568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a78b98-ce78-4ab0-968a-8b22ab8fa813 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.070781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 330/666] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:24.071492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78b98-ce78-4ab0-968a-8b22ab8fa813 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.120700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 337/667] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:24.121459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.148788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.177629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64a78b98-ce78-4ab0-968a-8b22ab8fa813 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.199143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.212378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.212985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.213259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.213526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.214280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:24.214578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.216110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.233531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 331/668] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:24.233531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.243710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d0ccd2-8e13-42d3-bd98-afaf71904e3e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.284045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.284744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.285096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.285427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.286134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:24.286500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.287944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d998dabc-375e-4f48-ac8f-4e80c57ac2a5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.304394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 338/669] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:24.304394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.304394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.304394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.321934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:24.323242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:24.340818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d174808-9dcf-4c92-be49-b85be89077f4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.374362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.375475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.375860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.376157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.376788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:24.377086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.378429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.389372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 332/670] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:24.390155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.400031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 339/671] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:24.400863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.404185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.444889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.502782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc3c099-5ed1-484d-aeeb-1cda27e0e78d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.517255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd99bb04-df4d-4a3d-a089-7d4631f08c54 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.537370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.538087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.538362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.538631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.545355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.547394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.553491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.554185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.554463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.554727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:24.559021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.560175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 333/672] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.561513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.565782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.567222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:24.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.579888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 340/673] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.580823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.643438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.669165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee33ac37-d59c-4979-9a8e-9b3d19956e4b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.670874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.684728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeed67d-71cd-4d9a-a469-e851a53ea3c8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.704067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.704718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.704996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.705264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.715034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:24.717782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.718393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.719315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.719584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:24.721613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.722699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 334/674] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.723556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.728357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.729780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:24.742049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:24.743136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 341/675] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:24.744506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.827982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d0e0ed-f719-4a76-af46-af1a98275b60 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.840873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7da8c78-0e1f-4021-a83f-2204333096a8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.860032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.860631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.861174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.861174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.861834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:24.862136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.863563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.865558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.875860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 335/676] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:24.876680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.882391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:24.883069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:24.883417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:24.883784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:24.884558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:24.884871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:24.886275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:24.898087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 342/677] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:24.898806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:24.901703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:24.975031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b545c2-e1d9-440e-badf-4599b34f4fef None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:24.998499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4fe477-26d3-4dbf-8ae7-82cdac15a07c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.008367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.008983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.009261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.009532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.019955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:25.024950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:25.026065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 336/678] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:25.027009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.038724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.039332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.039611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.039916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.040577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.040880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.042222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.050441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 343/679] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.051105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.098061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.108774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.129507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b16e17-e359-4450-a82a-16a69f0734c9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.150193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d26c34-274d-426b-8e16-c466b3f21cbc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.162903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.163500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.163796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.164067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.164744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.165039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.166443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.177808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 337/680] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.178573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.188331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.188935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.189214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.189488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.190208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=c71d74618fe94bddab05e457aaab72ff) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.190524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.191959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.197527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 344/681] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/role_assignments?user.id=c71d74618fe94bddab05e457aaab72ff&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.198294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.289315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338babb1-b3ca-433c-9a7c-a2a0c0f93adc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.313795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffabb37-caec-4854-899f-e64cdc08c0c6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.325699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.327685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.328445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.328862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.329272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.330231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=4601933cc2c047a8920d7450c0ee4f56) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.330548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.332023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.348057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 338/682] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/role_assignments?user.id=4601933cc2c047a8920d7450c0ee4f56&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.348057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.356156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.366882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.367674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.368098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.368478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.369555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.369869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.371291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.382365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 345/683] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.383281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.490126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bbcd3-2eac-441d-841f-e9609045dd3e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.527590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a89c7f-3444-4361-89eb-4ab4bd44c280 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.529255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.529939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.530167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.530433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.543469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.544983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:25.561252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:25.562490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:25.563621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:25.563621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:25.563621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:25.563621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 339/684] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:25.563621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.571184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.571824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.572106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.572881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.573674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=fff72313d3f14d8abbe9db7bf6e0501b) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.574040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.575915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.587564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 346/685] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/role_assignments?user.id=fff72313d3f14d8abbe9db7bf6e0501b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.587564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.650064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.664099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.711416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c69f70-2f24-41ce-b4c8-e25524bfcc77 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.742687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc468ffa-44ff-49b1-8ad5-df8be86723e3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.781796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.782415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.782684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.782946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.783595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:25.783936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.785303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.793595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:25.794247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:25.794522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:25.794786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:25.810026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 347/686] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:25.812994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:25.814463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:25.816945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:25.836529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:25.837571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:25.838474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:25.838474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:25.838474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:25.839930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 340/687] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:25.846354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:25.946800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:25.956659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cdbe369-34a4-409b-acf1-9d6f690be3e4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.976972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f76aee-a7ba-4571-9b27-c0d4f6f1d1e9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:25.991939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:26.000637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.001472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.001896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.002335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.009912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.011550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.025279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.025982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.026320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.026670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.027362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:26.027763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:26.028577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:26.029500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:26.030514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:26.031089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.037652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 348/688] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:26.039169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.043888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 341/689] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:26.059281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.223275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b830ec5-86fa-42ec-b893-49546c83bdcf None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:26.261193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03ebf44-7636-40b1-b09a-8a3258b2c6c7 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:26.275052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.276124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.276628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.277107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.278046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:26.279856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.282835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.319587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 349/690] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:26.323247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.340647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.341696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.342180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.342663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.353393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.355149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:26.367664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:26.368733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:26.369695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:26.371019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:26.378016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 342/691] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/users/swift => generated 83 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:26.379927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.417050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:26.545920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0542ba-1b9a-4694-b330-b6ceae815692 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:26.570587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b48cd8a2-36ea-4ce3-a233-e5f78ed57d5f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:26.621332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.621960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.622277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.622513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.623245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:26.623550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.624176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.624805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.625040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.625159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.625335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.674633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 343/692] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:26.680698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.698199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:26.699779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:26.722771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:26.807034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 350/693] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:26.812737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:26.899252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:26.912515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8783b2fa-1661-448c-b63b-a8c99ef003f4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:26.948745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:26.949693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:26.950203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:26.950670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:26.990221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872c5954-2201-45ed-ac07-42b44498a7fb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.019842 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.022155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.024062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.060560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.061127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.061410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.061680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.078089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.079538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:27.111024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:27.112069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:27.112971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:27.112971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:27.112971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:27.112971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 351/694] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:27.126009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.128434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.138528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 344/695] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 20 04:39:27.141118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.251114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcab1c3-9670-4a91-8d52-7061028bc227 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.290029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1572dd-d318-4aed-9aae-46bb1a15c8ad None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.321284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.321851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.322129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.322401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.336867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.338313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.352321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.352937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.353217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.353493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.354148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:27.354513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.355911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:27.363614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:27.364589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:27.365485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:27.365485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:27.365485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:27.370594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 345/696] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:27.371437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.379829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 352/697] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:27.385267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.434710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.450260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.549531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04760ef9-c557-41ad-958a-dcb70ef43712 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.577456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b3476-c829-4ac3-a9a3-6b5482f09aed None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.594930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.595606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.596017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.596297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.597057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:27.597361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.598746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.614318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.614954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.615233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.615507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.622487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.623958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.624371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 346/698] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:27.630258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:27.635607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:27.636567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:27.637751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 353/699] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:27.644823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.807582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.834975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab89a8d-ada3-4b75-922f-0474d6311743 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.836005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:27.840633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3907ab-0a10-4ff8-b1b6-aee1030be4a4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:27.892793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.893267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:27.893429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.893696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.893970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.894486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.894766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.895035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.895769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:27.896079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.897976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-143e63ff-2cb6-4816-ba6a-b154d2335548 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.902457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:27.904257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:27.916229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:27.917316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:27.918447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:27.918969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 354/700] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:27.918969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81634c-0948-428c-b4b2-1ebc9eec392d None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:27.918969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81634c-0948-428c-b4b2-1ebc9eec392d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:27.918969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e81634c-0948-428c-b4b2-1ebc9eec392d None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:27.920646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 347/701] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:27.922095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:27.924480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 355/702] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:27.927431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81634c-0948-428c-b4b2-1ebc9eec392d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.052361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f84cd4-ddb8-4c0c-af93-acec69a53497 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.065516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e81634c-0948-428c-b4b2-1ebc9eec392d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.104386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.104977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.105287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.105795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.106930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:28.107424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.109006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef649275-c740-4847-9f18-f6d17b1d8654 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.112222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.113387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.114047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.114417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.115220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:28.115629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.117182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.119828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 348/703] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:28.124499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968920d3-7ff9-4521-ba09-a31cb6f4fb40 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.124840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968920d3-7ff9-4521-ba09-a31cb6f4fb40 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.125106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968920d3-7ff9-4521-ba09-a31cb6f4fb40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.141306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 356/704] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:28.148820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.155079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-968920d3-7ff9-4521-ba09-a31cb6f4fb40 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:28.156923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-968920d3-7ff9-4521-ba09-a31cb6f4fb40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:28.162033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.177476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.234930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 349/705] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:28.236388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c90b-753e-4f0f-859b-bb94939b33ca None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.236677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c90b-753e-4f0f-859b-bb94939b33ca None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.236953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70c90b-753e-4f0f-859b-bb94939b33ca None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.238336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 350/706] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:28.243441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f777-44fb-4034-ac6c-2df40aa8c490 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.243751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f777-44fb-4034-ac6c-2df40aa8c490 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.244026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a885f777-44fb-4034-ac6c-2df40aa8c490 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.249471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 351/707] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:28 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:28.249471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.249471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.249471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.269674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:28.271077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:28.281164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc619-97b6-4fde-87db-10d17602ecd4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.318284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.319675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.320206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.320672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.321587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=be18420a973d4c8ab00a488d465cdd03) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:28.322089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.323707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f5d63a-5e0b-40eb-8c7f-1f08dae8d00b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.330446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 357/708] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/role_assignments?user.id=be18420a973d4c8ab00a488d465cdd03&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:28.331625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.331933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.332254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.350922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:28.351640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 352/709] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:28.356888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:28.425737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.429524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 358/710] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:28.568868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.669925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.671415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.696753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72639eee-1b61-45f5-b7a0-359b4af62d1b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.744244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.744790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.745262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.745372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.758792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.760277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:28.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:28.778575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:28.779510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:28.779510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:28.779510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:28.779510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 353/711] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:28.779510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.803982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafcbfee-3627-44aa-9452-d7ce79c8f33b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.850043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.850695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.850971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.851239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.851874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.853245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:28.866874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:28.868323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:28.869279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 359/712] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:28.870156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:28.908847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05946ca2-b420-44cb-8088-613e2c488422 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:28.949592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.961344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:28.962272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:28.962744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:28.963224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] PATH_INFO: `/v3/services/network` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:28.964106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:28.965662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:28.972222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:28.984899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:28.986233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:28.987334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:28.995153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 354/713] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/services/network => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:28.995153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:29.005095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad55768-8ad0-4a6f-a672-01d80ef294c2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.048043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.049010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.049512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.050059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.050925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:29.051449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.053606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.071438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 360/714] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:29.073394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:29.117561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a961243-3601-49d6-a3c3-8ef4330c4475 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.154212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.154837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.155147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.155466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.156363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:29.156873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.159448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.166159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 355/715] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:28 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:29.167090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:29.217774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0a2a64-bc13-482c-beda-56b5ed18bd3f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.239520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:29.248827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:29.264071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.265074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.265849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.266339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.267144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] RBAC: Adding query filter params (name=network) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:29.267626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.269642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.280943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 361/716] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:29 2022] GET /identity/v3/services?name=network => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:29.280943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:29.286474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-294b449c-a927-47b2-87e2-56a712792c29 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.326171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.326776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.327050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.327320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.328681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.330159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.360106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 356/717] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:39:29 2022] POST /identity/v3/users => generated 254 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:29.361092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:29.400766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11eb9c15-3295-4dca-9b80-958815b67a80 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.458142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.458767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.459045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.459317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.460140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:29.460442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.461823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2336b1a0-c001-4fa2-b67c-04ae8790e463 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.469431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 362/718] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:29 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:29.521290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8eca3c2-4016-425c-a6d2-e6b55987cee5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:29.546598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:29.578684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:29.579499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:29.579797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:29.580074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:29.580762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] RBAC: Adding query filter params (type=network) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:29.581070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:29.582529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e001d34b-02d1-4818-94d9-61e437df81a2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:29.593989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 357/719] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:29 2022] GET /identity/v3/services?type=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:30.578724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20250f-5b01-4ca0-bcc5-a924e2cd5e49 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:30.579247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20250f-5b01-4ca0-bcc5-a924e2cd5e49 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:30.579247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b20250f-5b01-4ca0-bcc5-a924e2cd5e49 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:30.581092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 363/720] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:30.586337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ecc5-5710-4734-9f19-795bbcab9af4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:30.586789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ecc5-5710-4734-9f19-795bbcab9af4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:30.586871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de9ecc5-5710-4734-9f19-795bbcab9af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:30.605472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3de9ecc5-5710-4734-9f19-795bbcab9af4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:30.606650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3de9ecc5-5710-4734-9f19-795bbcab9af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:30.694805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 358/721] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:31.042250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20250f-5b01-4ca0-bcc5-a924e2cd5e49 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.108172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:31.121167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3876-3efe-4f48-ad9f-f14ad6eb2624 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.121778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3876-3efe-4f48-ad9f-f14ad6eb2624 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.122253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a81f3876-3efe-4f48-ad9f-f14ad6eb2624 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.123786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 359/722] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:31.129880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.130158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.130426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.160759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:31.161949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:31.175363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b20250f-5b01-4ca0-bcc5-a924e2cd5e49 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:31.218364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:31.219530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.219831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.220107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.240607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:31.248591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:31.249557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:31.250463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:31.256512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 364/723] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:31.261392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.293986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 360/724] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:31.376318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3243e69f-8295-4622-b2ab-0550558a06ea None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:31.394804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:31.428495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:31.429370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.429941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.430406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.431248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:31.431773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:31.433329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:31.446202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 365/725] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:31.453348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.529552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:31.585564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e3e8a3-5b68-4b01-b0df-9cf18c97cd55 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:31.641796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:31.642574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.642759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.643031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.659516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:31.660992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:31.680256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:31.681238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:31.682611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:31.682611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:31.682611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:31.682611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 361/726] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:31.683994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.689621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.805518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777ffd6-9296-4491-885b-abe064b9d324 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:31.849696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:31.862581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa067be-2675-4272-a7cd-9a31d07f4a6d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:31.868533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:31.869897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.870171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.870440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.888164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:31.894779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:31.895723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:31.897301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 366/727] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:31.902278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:31.938347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:31.938963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:31.939234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:31.941142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:31.941794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:31.942090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:31.943453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:31.970635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:31.971238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 362/728] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:31.973516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.100007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1da07-2caa-4672-b2b5-b0104d88d9b3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.153186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a272-d697-4286-9087-de46644229e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.153791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a272-d697-4286-9087-de46644229e8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.154064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a272-d697-4286-9087-de46644229e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.154595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3838a272-d697-4286-9087-de46644229e8 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.155701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838a272-d697-4286-9087-de46644229e8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:32.156585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838a272-d697-4286-9087-de46644229e8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.157957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3838a272-d697-4286-9087-de46644229e8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.167512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 367/729] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:32.177636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3508761a-f9eb-4b7c-8d6e-9c22f4607b57 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.181654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a272-d697-4286-9087-de46644229e8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.236182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.236830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.237103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.237370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.246602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.248203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ff6b4004-a7db-415c-89b2-ed95dabc35d1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:32.264082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:32.265083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:32.267064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 363/730] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:32.267852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e4b8-b2b9-490a-a72c-9a26af6eafb9 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.268955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e4b8-b2b9-490a-a72c-9a26af6eafb9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.268955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5791e4b8-b2b9-490a-a72c-9a26af6eafb9 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.271956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 364/731] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:32.276036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.276432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.276794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.295658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:32.297028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:32.304062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.310214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.311621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3838a272-d697-4286-9087-de46644229e8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.354170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.354771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.355049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.355322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.368410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.370109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.377451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 365/732] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:32.378097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-b3746eed-df70-4d18-8cea-a5b5749b34cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:32.390038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:32.391601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:32.392564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:32.392564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:32.392564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:32.395893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 368/733] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:32.398096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f720-78c7-4b38-a74f-d65418cc5464 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.398581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f720-78c7-4b38-a74f-d65418cc5464 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.399048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c911f720-78c7-4b38-a74f-d65418cc5464 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.405261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 369/734] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:32 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:32.406642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911f720-78c7-4b38-a74f-d65418cc5464 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.511947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a65845-feb6-4d81-aea5-bc3884318d50 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.528826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c911f720-78c7-4b38-a74f-d65418cc5464 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.545848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.546490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.547302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.547576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.548353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:32.548643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.550058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11005410-ac76-478e-bad6-214ff6ac8cea None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.566602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 366/735] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:32.567795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.568082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.568357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.572691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.573535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.573991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.574589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.575379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.576337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:32.576516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.578863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9881fa2-c1f6-46a0-b507-fe5a39fa319a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.589164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:32.590788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:32.594037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 370/736] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:32.595252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b715-f5af-4d26-a808-8dbe79e70e60 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.595537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b715-f5af-4d26-a808-8dbe79e70e60 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.595837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7328b715-f5af-4d26-a808-8dbe79e70e60 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.601129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 371/737] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:32.601129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328b715-f5af-4d26-a808-8dbe79e70e60 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.608144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.672822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 367/738] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:32.673677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.710778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7328b715-f5af-4d26-a808-8dbe79e70e60 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.747320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.747978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.748258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.748952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.760928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.763051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.773987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e827-f8d0-4be9-8655-2bbe2f4704ad None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d7389a53-7de3-42a9-9a3d-fd84da52a55c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:32.779448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:32.780410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 372/739] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.786419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.803570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:32.804878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:32.808488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.809105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.809380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.809645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] PATH_INFO: `/v3/users/swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.811626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.818857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.820496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:32.832583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:32.833711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:32.834908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:32.839244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 368/740] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/users/swift => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:32.840077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.867876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:32.881583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 373/741] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 20 04:39:32.884556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:32.944151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d695b67b-b9a4-44b8-a4b9-543bf2d0fdaf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:32.979290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:32.979915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:32.980191 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:32.980458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:32.981099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:32.982460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:32.999177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 369/742] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:39:32 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:33.000171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.008960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc99f4a-bc24-452d-95b9-44ad148966d2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.063307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.064536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.065022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.065573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.066487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:33.066994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.068939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.075521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.089182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 374/743] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:33.090589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.131208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7c2a63-2472-444c-97f4-8220bb11b340 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.144304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.172947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.173610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.173888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.174155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.174889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:33.175192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.176808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.195363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 370/744] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:32 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:33.196224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.205800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ba006-fbc5-48c1-92fb-e097deb545bf None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.248469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.249203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.249671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.250574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.261308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:33.266726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:33.267913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 375/745] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:33.268941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.304709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eed134-c533-4271-80f6-6b2278252df0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.317759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.338618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.339244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.339524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.339813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.347026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.348493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:33.360213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:33.361140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 371/746] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:33.362054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.383436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba5c523-c48f-4a36-acc0-c41713ea25b1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.391172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.420343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.420954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.421234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.422116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.422760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.424173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.444139 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 376/747] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:39:33 2022] POST /identity/v3/services => generated 240 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:33.453051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.475680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ae2236-7dcc-43cb-9ce5-4b51e0782f25 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.523541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.524410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.524690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.524956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.576111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.596210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f517d2-afc8-4411-94ec-576fb0818734 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.626099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.627924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.638307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.639148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.639615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.640152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.641584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:33.641887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.643251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.652948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 377/748] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:33.654517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.694573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.751984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 372/749] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:39:33.752881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.785427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e61f33f-57ec-45db-9383-ab1a78795f36 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.829488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.830096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.830623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.830896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.832043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:33.832351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.834291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.840278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.850885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 378/750] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:33.852126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.885212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da3775a-3f3d-4591-9f7e-a18b6a2723f1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:33.935771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:33.936725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:33.937058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:33.937374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:33.950323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:33.952377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:33.969110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:33.973234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:33.974164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:33.975060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:33.975060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:33.975060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:33.979454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 373/751] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:33.980395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:33.990824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c47994-e293-4b93-851f-d7f54426586f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.037003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.038581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.039050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.039504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.053289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.055541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:34.074915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:34.075959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:34.077088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:34.077088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:34.077088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:34.079911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 379/752] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:34.081349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.113761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf5b1bc-bb50-4651-ba50-be6d5f7611c2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.136003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.153292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.154251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.154715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.155175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.157671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=697f2e9daa334a068f10a5ba0671aed6, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.159315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.174498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 374/753] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:33 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:34.175575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.200676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f960ce-82bf-401a-870c-f89cdb04c357 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.242787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.243524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.243990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.244283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.245109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:34.245454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.247197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.259055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.263185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 380/754] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:34.270049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.318618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c467bbb-e30f-4786-9b10-e81e152b7225 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.389045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29248b93-aa03-48b8-bbf9-b0c4c5b2c513 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.408456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.409381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.409661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.410171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.411202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:34.411516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.413428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.430634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 375/755] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:34.432615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.433263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.433544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.433816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.443763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.446248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.447799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:34.463284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:34.464311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:34.465332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 381/756] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:34.471009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.524165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.536058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.579906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cc0559-553a-4e90-bfce-9e50bc46acd4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.614949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.615560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.615881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.616182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.616867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:34.617169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.618607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.637092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 382/757] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:34.642487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.645432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8739b59-2872-47f3-b914-b4839c49cf09 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.713728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.723657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.723964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.724241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.740595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.742055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:34.770653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:34.772392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:34.773323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:34.773764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 376/758] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:34.778281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:34.822884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2b7a97-c073-4ac2-a920-c37e769fc689 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.841212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.861263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.862149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.862580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.863016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.911309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:34.914209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c79450-6f1a-4ca8-886e-d637e20511a6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:34.935598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.937857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.956960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:34.956960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:34.956960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:34.956960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:34.957411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:34.957411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:34.957411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:34.971832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 377/759] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:34.976043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:35.121362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 383/760] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:39:35.127665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:35.154398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a178f74b-22e5-4217-8be3-9bbf6004f59a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:35.158427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:35.215420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:35.216070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.216351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.216624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.217462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=be18420a973d4c8ab00a488d465cdd03) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:35.217709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:35.220043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:35.226350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 378/761] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:34 2022] GET /identity/v3/role_assignments?user.id=be18420a973d4c8ab00a488d465cdd03&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:35.303058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07795d-2a90-442b-bc35-795554600284 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:35.358689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:35.360334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.360847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.361325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.373334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:35.375789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:35.392161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:35.393223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:35.394142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:35.394142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:35.394142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:35.396308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 384/762] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:35.402337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:35.452175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:35.563271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b356848b-9da2-457b-aae7-64afb21250bc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:35.608752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:35.609781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.610268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.610753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.611611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:35.612150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:35.613714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228aee1d-3095-4bb8-ad9f-ca85dd61ebe7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:35.631424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 379/763] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:35.636995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:35.714550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498aea-a0ec-44fa-872f-d8c5ad62f59d None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.715205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498aea-a0ec-44fa-872f-d8c5ad62f59d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.715694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01498aea-a0ec-44fa-872f-d8c5ad62f59d None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.717253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 380/764] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:35.733683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.734359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.734899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.744858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:35.765243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:35.768061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:35.803702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885305d-b2a6-4fea-b6d2-2a4ad55a06ac None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:35.867969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:35.870357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:35.873831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:35.874343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:35.885694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:35.888124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:35.908230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 381/765] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f338a2d3-4402-4059-9a6e-4b5a2d16cdf0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:35.911408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:35.912391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:35.913396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:35.915995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 385/766] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:35.925025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:35.949210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:36.035517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473726a-72f9-4d16-ab3c-2e78485f54e4 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.036463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473726a-72f9-4d16-ab3c-2e78485f54e4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.036974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4473726a-72f9-4d16-ab3c-2e78485f54e4 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.038843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 386/767] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:36.043634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.044347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.045195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.058414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d0ad96-5259-44c9-9672-bb8d3a08c76f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.078744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:36.080612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:36.126801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.127335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.127610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.127906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.130820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:36.131132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.132588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.164095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 382/768] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:36.180334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.223663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 387/769] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:36.299373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:36.322425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.339661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d73913d-7e0a-4612-9325-e71b683a6b67 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.414766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.415752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.416238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.416708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.417648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=51c05b0002454c93a8c2ffbd0cef784d) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:36.419779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.422804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.430595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:36.437927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 383/770] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/role_assignments?user.id=51c05b0002454c93a8c2ffbd0cef784d&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:36.487569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feed0d2-69a9-4e16-a8c8-edc949fb288b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.505705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.570669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.571345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.571623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.571929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.572539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.573945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:36.589496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:36.590586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:36.591445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:36.600106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 388/771] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:36.603148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.666671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0453f22-a4c9-4170-934d-18fe3803fdfc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.743168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.744257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.744756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.745228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] PATH_INFO: `/v3/services/network` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.746018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.750901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:36.772292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:36.773351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:36.774811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 384/772] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/services/network => generated 88 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:36.780701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.787041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:36.789925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94295cd5-0ce1-4d8e-a88f-7169e8f88388 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.823901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:36.836447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.837561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.838467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.838958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.840086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:36.840593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.842143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a929bdc8-fbd0-42ba-8041-9c86afe034f1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.848127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 389/773] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:36.850167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bbb38-1468-4b00-9a06-740536eeb6f3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.850681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bbb38-1468-4b00-9a06-740536eeb6f3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.851150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7bbb38-1468-4b00-9a06-740536eeb6f3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.853029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 390/774] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:36.853966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bbb38-1468-4b00-9a06-740536eeb6f3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:36.899077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d9937b-f071-4c7c-9033-6e5e4669f669 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:36.934359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:36.934970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.935201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.935482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.936157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] RBAC: Adding query filter params (name=network) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:36.936514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:36.938505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da52112-bf64-48dc-963d-78ccbdea66da None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:36.947921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 385/775] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/services?name=network => generated 124 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:36.949252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:36.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:36.949871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:36.971190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:36.972473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:36.980749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7bbb38-1468-4b00-9a06-740536eeb6f3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.022444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.023415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.023986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.024465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.025462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:37.025963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.027848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.034665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 391/776] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:36 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:37.036424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.039349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.051826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 386/777] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:37.053222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.140099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.227660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4456b6f6-7b1c-464f-9659-3d10f531f00d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.246246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf0683-83a3-4fac-969a-a38860fd3c43 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.297095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.298077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.298574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.299042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.299966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] RBAC: Adding query filter params (interface=public, service_id=a22158123ada4a5ea6f97af3a7d47f57, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:37.300425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.300816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.301041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.301322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.301593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.302220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] RBAC: Adding query filter params (type=network) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:37.302517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.303432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.303886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.311940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 387/778] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/endpoints?service_id=a22158123ada4a5ea6f97af3a7d47f57&interface=public®ion_id=RegionOne => generated 194 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:37.317565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.318659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 392/779] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/services?type=network => generated 350 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:37.323314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.420390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.480841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb047da9-c42a-4e73-8307-8c93ddc88d42 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.497813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56efaf62-70ee-43ec-97cf-17f4c74028a8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.517039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.526735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.527351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.527632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.528099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.529024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.530659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.537652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.537814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 388/780] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/services => generated 772 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:37.538461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.544397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.544683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.545124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.546000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] RBAC: Adding query filter params (interface=public, service_id=9f80de7f061d4b0ba2e86b59893cf484, region_id=RegionOne) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:37.546383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.547945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.568110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 393/781] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/endpoints?service_id=9f80de7f061d4b0ba2e86b59893cf484&interface=public®ion_id=RegionOne => generated 194 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:37.580434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.700299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7f994e-2fab-4e48-9167-2c48903efbb2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.728692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.747298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.748078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.748352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.748617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.761917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-74276210-4fb2-4f3e-a7e4-b1dfe1ba7b68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:37.767411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:37.768399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:37.769267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 389/782] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:37.770463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d131-14b8-4e57-a884-3360f035cb78 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.770463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d131-14b8-4e57-a884-3360f035cb78 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.770640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad7d131-14b8-4e57-a884-3360f035cb78 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.777455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 390/783] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:37.780698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d131-14b8-4e57-a884-3360f035cb78 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:37.794896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6dac41-2e53-4d07-ba04-2af1f7b27635 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.839755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:37.840649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.840937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.841209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.842087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:37.844465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa4e955-d85b-4b94-a649-a59f16fd1854 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:37.852617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 394/784] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/services => generated 772 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:37.857211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199976-52af-484a-af68-e6dcc61be093 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:37.857503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199976-52af-484a-af68-e6dcc61be093 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:37.857771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14199976-52af-484a-af68-e6dcc61be093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:37.881995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-14199976-52af-484a-af68-e6dcc61be093 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:37.883483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-14199976-52af-484a-af68-e6dcc61be093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:37.935008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:37.959074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad7d131-14b8-4e57-a884-3360f035cb78 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:37.971864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 395/785] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:38.007569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.008222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.008503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.008839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.009520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:38.009825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.011298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.022467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 391/786] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:38.027955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199976-52af-484a-af68-e6dcc61be093 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.148667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14199976-52af-484a-af68-e6dcc61be093 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.184477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.185115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.185390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.185661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.196252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.197711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:38.213388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:38.215467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:38.216608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:38.216608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:38.216608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:38.216608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 396/787] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:38.220742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.270961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:38.328544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88326cf8-4ed8-4c76-a9da-045a062ccb6e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.350102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.393673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.394304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.394584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.394857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.395502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:38.395827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.397457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.412086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:38.426228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 392/788] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:38.431472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.491052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b3150-2181-4db3-9833-1673cca68084 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.532265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.533150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.533436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.533708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.544343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:38.550909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:38.551916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:38.553347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 397/789] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:38.557931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.659434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:38.677539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f18f89-8a7b-4489-84d6-e508a9b2db79 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.717351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.717984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.718783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.719066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.719760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:38.720080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.721481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.731360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 398/790] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:38.737739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.774773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0fada3-8382-49f9-afcb-ab0ef40d3229 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.788199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:38.847471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c223a503-75e0-43e5-a660-c55ca0c8a9a6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:38.853078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.853728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.854011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.854285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.867167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.868687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6bdeabbb-ec5b-444d-af32-9357285319a1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:38.882910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:38.883934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 393/791] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 453 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214052-a4c2-4ddb-83fa-25659bed5aa8 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.886137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214052-a4c2-4ddb-83fa-25659bed5aa8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.887869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8214052-a4c2-4ddb-83fa-25659bed5aa8 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.887869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 394/792] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:38.895411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:38.896080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.896360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.896635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.897212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8214052-a4c2-4ddb-83fa-25659bed5aa8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:38.908921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:38.910491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:38.919079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d7502bfe-53c2-450a-a72c-81fecdc9c8a6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:38.927571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:38.928787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:38.929884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:38.929884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:38.929884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:38.931933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 399/793] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:38.937859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:38.938239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:38.938619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:38.958013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:38.959457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:39.022953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8214052-a4c2-4ddb-83fa-25659bed5aa8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.052064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 400/794] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:39.052064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.091790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.092461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.092742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.093014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.093788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:39.094093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.095532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.137628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 395/795] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:39:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:39.141687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.187316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.212809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0a6964-df2c-4fa1-990a-8bdca9e14b9c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.268883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.277893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.278508 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.278784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.279055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.279702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:39.280041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.282000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.306455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 401/796] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:39.313460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.314471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e04856b-5366-4755-9920-fbc38bcd020a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.377525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.378142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.378417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.378695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.475552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829741db-eac9-4f26-98f8-a1e5da979b7b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.476883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.478350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.506288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.514599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.515750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.516188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.516606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] PATH_INFO: `/v3/users/swift` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.525060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.526728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:39.539879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:39.541067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:39.542269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:39.550181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 402/797] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/users/swift => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:39.550181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.602530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 396/798] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:39:39.602530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.614583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.674832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a9f4b0-d218-499e-b981-15794ff5b488 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.715919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.716606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.716814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.717084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.719465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-618fd88f-f063-4bcd-9ffd-693d99f7416f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.734609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:39.741012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:39.742087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:39.742973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:39.747774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 403/799] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:39.748652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.757110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.771277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.772696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.773183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.773630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.774537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:39.775445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.777359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.804261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 397/800] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:39.804261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.872662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960db412-a786-4fc6-9ee4-a575e33de9df None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.883563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:39.914761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.915415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.915689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.915986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.931084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.932673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:39.942166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179e912-35c7-4649-b82d-7b831c2d9046 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:39.951318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:39.952361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:39.953320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:39.953320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:39.953320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:39.957567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 404/801] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:39.958261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:39.988859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:39.990577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:39.991614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:39.991899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:39.993602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:39.993903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:39.995268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.008992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 398/802] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:40.009890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.061868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.088375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b558f-7cb1-42b2-be53-a23988375560 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.123330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.123908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.124015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4206f4d6-b7c1-4805-b9c2-4de7d3abb82b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.124185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.124477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.138645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.140716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:40.157239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:40.158202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:40.159114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:40.159114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:40.159114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:40.159114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 405/803] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:40.159114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.164579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.165198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.165478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.165809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.166458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:40.166759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.168180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dffd700-0c10-4a1d-b79a-fe94e68460a4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.177215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.181584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 399/804] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:40.183040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b0b3-c62a-4cf0-be3b-c8c5e40d218f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.183524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b0b3-c62a-4cf0-be3b-c8c5e40d218f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.184036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b86b0b3-c62a-4cf0-be3b-c8c5e40d218f None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.185431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 400/805] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:40.186338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b0b3-c62a-4cf0-be3b-c8c5e40d218f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.270438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69014e8-dae6-41a4-82d4-9ca5af3938f6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.310790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.311450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.311751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.312561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.324981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.326462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:40.343891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:40.344919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:40.351065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:40.351065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:40.351065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:40.351065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 406/806] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:40.351065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.417691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b86b0b3-c62a-4cf0-be3b-c8c5e40d218f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.420441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.420756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.455999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.456608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.456882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.457151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.457783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:40.458081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.458370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-839c33da-6d76-4d20-b828-8f0d1ab80cc1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.459441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fd3d3d-1263-4438-a17b-aaa54c4f698b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.470366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 401/807] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:40.471508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ac17c-a396-49ed-9a91-7dc89fc3bdab None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.471816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ac17c-a396-49ed-9a91-7dc89fc3bdab None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.472162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ac17c-a396-49ed-9a91-7dc89fc3bdab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.493359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fa6ac17c-a396-49ed-9a91-7dc89fc3bdab None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:40.494628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa6ac17c-a396-49ed-9a91-7dc89fc3bdab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:40.495227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.495894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.496174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.496449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.503677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.505157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:40.516224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:40.517335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:40.518457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:40.520008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 407/808] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:40.520792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.561813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 402/809] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:40.564378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668d0a4-98eb-4cd5-b0de-6f63cff8e403 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.564765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668d0a4-98eb-4cd5-b0de-6f63cff8e403 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.565197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e668d0a4-98eb-4cd5-b0de-6f63cff8e403 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.566442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 403/810] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:40.567137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668d0a4-98eb-4cd5-b0de-6f63cff8e403 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.639739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80ac794-090f-47b8-9e1f-99138d4fd7f0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.662099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.669909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.670469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e668d0a4-98eb-4cd5-b0de-6f63cff8e403 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.682266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.683325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.683809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.684487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.685666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:40.686389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.688923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.707274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 408/811] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:40.707274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.710876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.711509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.711819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.712091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.718869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.720327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-67e0bccd-69c6-46c6-bd5d-79a7d3a4f106 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:40.732098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:40.733011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:40.734475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 404/812] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:40.735571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.735571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.735571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.753086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:40.754255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:40.815172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f23423-f7be-496c-8bff-83d28e085423 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.823354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 405/813] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:40.824831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.848409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.849243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.849673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.850095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.850966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:40.851431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.853018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.869952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 409/814] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:40.869952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:40.918124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.922043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:40.934836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faa936b-493d-4f38-928b-3a89ec93dce8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.967933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:40.969066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:40.969338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:40.969601 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:40.976510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:40.977927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:40.983341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6044f015-9bf8-4664-9aa9-1ea4137af6b7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:40.992058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:40.993006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:40.993963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 406/815] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:40.995022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.024931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.026021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.026847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.027534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.028398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.028849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.030668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.043913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 410/816] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.044878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.100049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4f9607-2182-4964-bfad-7062e7eb36c6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.134877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.135497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.135797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.136068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.136640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.137994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:41.147304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:41.148476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.149351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 407/817] 10.222.0.42 () {56 vars in 1129 bytes} [Tue Sep 20 04:39:40 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:41.150136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.152442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279707f9-8bc0-4552-9324-99c598a5761a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.160925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.161772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.189183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.189715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.189992 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.190260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.190977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.191282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.192762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.198304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 411/818] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.199050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.280124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ddd4b3-1438-4c3c-b753-79103c628f25 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.320688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.321383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.321646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.321912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.322712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.323012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.324568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.351781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 408/819] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.351781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.425033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.438967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c1a8034-cff1-453e-95a6-e638c6189206 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.466352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b8d626-0163-4b34-a5eb-d75d4147c330 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.476689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.477347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.477621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.477889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/be18420a973d4c8ab00a488d465cdd03/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.479813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=be18420a973d4c8ab00a488d465cdd03, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.481235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.494536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 412/820] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:41 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/be18420a973d4c8ab00a488d465cdd03/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:41.495417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.518049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.518710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.518988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.519319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] PATH_INFO: `/v3/services/network` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.519970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.521548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:41.533350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:41.534448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 20 04:39:41.535307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.539937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 409/821] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:41.541057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.542262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.653592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd8e4cc-3af0-44ed-b7ea-8a5e2505dd3f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.670077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87333266-a537-4eb2-9a8e-cbf5b0cf0034 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.701939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.702452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.702728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.702997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.703621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.703951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.704290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.706320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.713128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 413/822] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.713279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.713832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.713961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.714139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.714375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.726289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.728070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:41.747032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:41.748269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:41.749378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:41.749378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:41.749378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:41.750141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 410/823] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:41.750971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.823979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:41.832988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aad2e1-568c-4a2f-b2a4-cbdc3f1d0b9c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.869490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.870368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.870706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.871042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.871780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] RBAC: Adding query filter params (name=network) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.872145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.873668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.883841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 414/824] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/services?name=network => generated 124 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.884786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.885140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98be426-a1c3-4bac-8f66-ea4888afda6e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:41.928666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:41.929406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:41.929752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:41.930106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:41.930799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:41.931161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:41.932960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:41.938719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 411/825] 10.222.0.42 () {56 vars in 1124 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:41.939747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:41.995253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:42.024327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5a2400-f321-48a7-a79e-55f33d641a73 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.064275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.064882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.065164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.065431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.066379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:42.067081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.068774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.069593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35a6cab-0073-4306-8dc2-ad9f9be6643e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.081888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 415/826] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:42.082836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:42.116131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:42.122523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.123148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.123409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.123675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.124533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] RBAC: Adding query filter params (type=network) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:42.125347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.126705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.133935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 412/827] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:41 2022] GET /identity/v3/services?type=network => generated 350 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:42.136005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:42.228433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1062b5-77ee-49dd-9027-5c655b8678de None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.244984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e480b0c8-30d4-4c46-bc0d-37b9daf7e7f0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.257493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:42.285841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.286269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.286549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.286826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.288053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.290864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.302388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.303318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.303815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.304281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.312782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.314541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.325870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 416/828] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:39:42 2022] POST /identity/v3/endpoints => generated 346 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:42.326730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:42.328648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:42.329540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:42.329986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:42.331819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 413/829] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:42.345024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:42.495816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:42.557127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a9495e-a772-4cd6-bcb0-7c6fb9b365bb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.561939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f353c696-36c1-4b7e-8529-ee514aad7dfc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.613672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.614930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.615670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.616595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.617325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.618173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.618922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.619366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.620879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8abcd5e-4453-4133-9d86-a7570e049465 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.621295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.622121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:42.622587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.626388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.641318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 414/830] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:42.647582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:42.663173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 417/831] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:39:42 2022] POST /identity/v3/endpoints => generated 337 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:42.705217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:42.801871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17a310-b2fa-43a8-b75c-44c84879d79f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:42.865977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:42.866561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:42.866835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:42.867104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/51c05b0002454c93a8c2ffbd0cef784d/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:42.883911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=51c05b0002454c93a8c2ffbd0cef784d, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:42.885360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b2caac-c0fb-4afc-8cf4-24b1c0b2c621 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:42.908724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 415/832] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:42 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/51c05b0002454c93a8c2ffbd0cef784d/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:43.638491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447131c-7a9e-4c63-909b-2db49e3ee8c3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:43.639048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447131c-7a9e-4c63-909b-2db49e3ee8c3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:43.639048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2447131c-7a9e-4c63-909b-2db49e3ee8c3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:43.641157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 418/833] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:43.646518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea491-7971-44ee-bbc7-7605c78379ce None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:43.647193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea491-7971-44ee-bbc7-7605c78379ce None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:43.647309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3ea491-7971-44ee-bbc7-7605c78379ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:43.667096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-eb3ea491-7971-44ee-bbc7-7605c78379ce None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:43.668348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-eb3ea491-7971-44ee-bbc7-7605c78379ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:43.743311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 416/834] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:43.790667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b131-d930-4907-8a80-db200f56dcd6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:43.790998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b131-d930-4907-8a80-db200f56dcd6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:43.791208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c070b131-d930-4907-8a80-db200f56dcd6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:43.792816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 419/835] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:43.798574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:43.798858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:43.799126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:43.812118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:43.818754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:43.819978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:43.888643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 417/836] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:43 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:44.021661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b131-d930-4907-8a80-db200f56dcd6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.127545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c070b131-d930-4907-8a80-db200f56dcd6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.154362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:44.160311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.166120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.166755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.167031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.167298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.168421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.169447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:44.180453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:44.182119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:44.183339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 420/837] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:44.188158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.285061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3788abfe-b55a-44de-ac38-c24aa5704149 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.311448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2065c131-54c7-4dcc-afc3-2daa6f84ce52 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.327542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.329221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.329681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.330284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.337644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:44.344825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:44.351103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:44.352095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:39:44.352932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:44.354064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.354933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.355459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.355958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.356836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:44.357340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 418/838] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:44.357464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.358371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.359262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.370247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 421/839] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:44.371404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.434859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:44.485115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfb7bcd-cc8a-47ff-8475-8ff7e579352e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.486647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ecb24d-c473-4559-ac88-15f179078efd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.528533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.528773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.529195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.529478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.529751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.530270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.530455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:44.530763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.531658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.532163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.532658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.533278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:44.534476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.536129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.547083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 419/840] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:44.547693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 422/841] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:44.548127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.624065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:44.681064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86219a90-f728-4a13-af32-370c60f886b0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.722401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.723419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.723938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.724464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.738424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.740346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-837fc6c6-cd00-43df-b34d-3d41a2e6d97e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:44.756813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:44.757827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:44.758732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:44.758732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:44.758732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:44.758732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 420/842] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:44.765127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.780071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d50-7092-4be3-83ec-86cd95a85408 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.780386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d50-7092-4be3-83ec-86cd95a85408 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.781141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ea3d50-7092-4be3-83ec-86cd95a85408 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.782522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 421/843] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:44.788196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.788633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.789061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.807983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:44.809423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:44.876482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251671f9-0c20-4300-b1ce-e2746e23bb1c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:44.879135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 422/844] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:44 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:44.904096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:44.913334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:44.914284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:44.914774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:44.915282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:44.916219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:44.917047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:44.919591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:44.932740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 423/845] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:44.940908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:44.983552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.053444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22a30f65-bb1a-4ffc-96e3-488b092868c9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.089049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.089681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.089998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.090255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] PATH_INFO: `/v3/users/swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.097918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.099360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:45.111937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:45.112892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:45.113854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 423/846] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:39:44 2022] GET /identity/v3/users/swift => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:45.119374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.172161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.232259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5697ef3f-be0b-4f9b-8044-f4ccfbdd552e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.267749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.268359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.268638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.268917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.269647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:45.269951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.271362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8750e77-561a-4f9d-a89c-0b0ec266a2d3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.289431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 424/847] 10.222.0.42 () {56 vars in 1135 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:45.290580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050996-f708-4e20-886a-b26981e4d627 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.290869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050996-f708-4e20-886a-b26981e4d627 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.291142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43050996-f708-4e20-886a-b26981e4d627 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.292625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.295879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 425/848] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:45.297430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7c5a6c-0998-4185-9b41-282e29e4726c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.297562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050996-f708-4e20-886a-b26981e4d627 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.335292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-806d59de-f646-4456-b025-36832481a35e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.335900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d59de-f646-4456-b025-36832481a35e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.336183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d59de-f646-4456-b025-36832481a35e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.336456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806d59de-f646-4456-b025-36832481a35e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.336883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.337087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d59de-f646-4456-b025-36832481a35e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.338419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-806d59de-f646-4456-b025-36832481a35e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-806d59de-f646-4456-b025-36832481a35e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:45.348126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:45.349146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:45.350000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 424/849] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:45.350807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.351445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.351445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.370118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:45.371309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:45.417302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43050996-f708-4e20-886a-b26981e4d627 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.442267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 425/850] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:45.443140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.470215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.471403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.471910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.472800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.542986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.551672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c005e636-5888-4b18-8d11-4ab4d8de2b0d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.568267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.569706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.597859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.599440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.599949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.600678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.601887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:45.602596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.604188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.606137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.616094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 426/851] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:45.616728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.700264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 426/852] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:39:45.701716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.731369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4e21e3-8098-4d9f-ae2d-dd2988c583f1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.766152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.766757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.767029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.767297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.767947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:45.768243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.769597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.783933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 427/853] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:45.784982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.817338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.829505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cb9263-75fc-47d8-b464-dad1726e29c3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.868833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.869319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.869594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.869863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.873672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:45.882163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:45.883879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:45.902007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:45.903066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:45.904050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:45.904050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:45.904050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:45.908525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 427/854] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:45.909972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:45.934210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e1726d-674a-428f-8b80-4a6490382be4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:45.978295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:45.979084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:45.979431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:45.979816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:45.992156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:45.997372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:45.998317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:39:45.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:46.001027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 428/855] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:46.006064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.032022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7505f4-b763-436e-95ca-73a94a4cc8d3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.077933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.078818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.079154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.079891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.080814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:46.081121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.082685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.098287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 428/856] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:46.103655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.105777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.131882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbe7099-1f2f-44ce-807b-f28f69d36f32 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.160582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.180740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.180740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.180740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.180740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.181912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:46.181912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.183231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.194289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 429/857] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:46.201576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.241090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de1dc85-2128-4632-add7-3e051dcc0500 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.283060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.284156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.284610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.285079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.292686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.294136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:46.307671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:46.308657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:46.309570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:46.310012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 429/858] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:46.315846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.322483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9abb98-ff72-4c83-ab4c-cb364b9885c6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.359301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.359980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.360255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.360522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.372182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.373726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.377537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:46.391857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:46.393038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:46.394165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:46.394165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:46.394165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:46.397867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 430/859] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:46.399027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.444806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ed8c544-475f-4628-a101-ce8e26409301 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.454859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.485652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.486269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.486549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.486823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.487525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:46.487862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.489885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.512126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 430/860] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:46.514135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.526705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace4328f-dae0-466e-9f7f-d9d5ae900cf1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.573664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.574281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.574601 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.574879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.576100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:46.576404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.578639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.602969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 431/861] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:46.608596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.633345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11736f-b8ea-4b12-8f10-d1286e77c4c3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.673770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.674303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.674633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.674905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.675626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=be18420a973d4c8ab00a488d465cdd03) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:46.675987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.677369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.686128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.688374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 431/862] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/role_assignments?user.id=be18420a973d4c8ab00a488d465cdd03&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:46.743070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d1aad-8100-4a2e-869a-c94393f7be87 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.787047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:46.788132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.788598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.789053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.797600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:46.799360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5053ff7e-cfcf-4866-a0ce-db58e5b9819f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:46.813078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:46.814098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:46.815065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:46.817433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 432/863] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:46.825265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:46.863398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:46.872332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706989fd-5bc7-49d8-b1a3-7950c1e4e81a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.872902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706989fd-5bc7-49d8-b1a3-7950c1e4e81a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.873321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706989fd-5bc7-49d8-b1a3-7950c1e4e81a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.876669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 433/864] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:46.880791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:46.881074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:46.881343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:46.901748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:46.902915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:46.955138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301e8a56-4372-45bc-b4ef-f2b3c97937c1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:46.978640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 434/865] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:46 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:46.999363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.000010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.000344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.000626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.001473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:47.001782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.003253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.021709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 432/866] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:39:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:47.027025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.076311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:47.133233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b945290-e6fc-4d05-bfc6-05584a70fb56 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:47.169408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.170021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.170302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.170576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.256948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.259360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.308519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.309664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:47.377877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 435/867] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:39:47.384132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.424891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:47.439869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78dde2da-2d8d-4cbd-b89d-8f2f24432aa3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:47.481472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.482654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.483570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.484359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.485212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.486938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.511872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 433/868] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:39:47 2022] POST /identity/v3/services => generated 269 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:39:47.537152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848b863f-620b-4f69-b589-609aa65d7a2c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:47.586134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.586787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.587114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.587384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.599860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.601315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.603397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:47.619049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:47.620190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:47.621196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:47.621196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:47.621196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:47.621196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 436/869] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:47.626786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.744384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a951ded1-4d74-461f-9d78-4da517e6df86 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:47.781621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.782579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.783071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.783547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.784488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:47.785001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.786630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.800051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 434/870] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:47.805150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.911673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50696ad-fc94-4b8d-9806-10eb7b2f4200 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:47.949446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:47.950461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:47.951011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:47.951489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:47.959318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:47.961067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-45905abd-7002-481c-869e-617c8fca26ab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:47.973412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:47.974324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:47.975238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:47.977587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 437/871] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:47.987777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:47.995855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:48.022533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cdb3-df3f-4791-9345-8f8ffa945ffa None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:48.022858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cdb3-df3f-4791-9345-8f8ffa945ffa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:48.023082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df4cdb3-df3f-4791-9345-8f8ffa945ffa None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:48.024701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 438/872] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:48.029618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:48.029903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:48.030169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:48.049178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:48.050304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:48.102927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998d1e77-de90-4fb0-9d96-50441f8f18ea None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:48.124162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:48.135275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 439/873] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:48 2022] POST /identity/v3/auth/tokens => generated 1271 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:48.145020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:48.145626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:48.145897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:48.146161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:48.147114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:48.147415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:48.148870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:48.161173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 435/874] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:48.166937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:48.266632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cfc163-22a4-4fc3-9f8d-e9ac655b6e75 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:48.302089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:48.302671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:48.302951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:48.303219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:48.303961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=51c05b0002454c93a8c2ffbd0cef784d) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:48.304267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:48.305674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d400a776-f1e1-4b50-aa62-c73a2a94b138 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:48.311960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 440/875] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:48 2022] GET /identity/v3/role_assignments?user.id=51c05b0002454c93a8c2ffbd0cef784d&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:48.416155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:48.506884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:48.542869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bd7c2-28e2-429f-bb1f-bf6e4eed6dcb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:48.578888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:48.579470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:48.579764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:48.580038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:48.580686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:48.582034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a7fb66-83ed-410a-9c1b-f523bbf8e7a4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:48.599776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 436/876] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:39:48 2022] POST /identity/v3/services => generated 251 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:49.000720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703895e3-a127-40d0-93c0-d2ace880e554 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.001268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703895e3-a127-40d0-93c0-d2ace880e554 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.001268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703895e3-a127-40d0-93c0-d2ace880e554 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.002882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 441/877] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:49.008259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.008654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.008831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.027709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:49.028957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:49.107844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 437/878] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:49.375606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703895e3-a127-40d0-93c0-d2ace880e554 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:49.426908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:49.486405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703895e3-a127-40d0-93c0-d2ace880e554 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:49.521212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:49.522428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.522872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.523300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.524090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:49.525718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:49.535562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:49.536866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:49.537941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:49.545069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 442/879] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:49 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:49.547151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:49.605693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:49.653314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4633e78c-7187-4ebe-ae4a-c8034be9ea50 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:49.689514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:49.690126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.690400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.690668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.691302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:49.691600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:49.692997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9811a7-8c38-4221-9987-16d0f32cbff5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:49.698638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 438/880] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:49 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:49.705227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:49.816749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d954deea-1376-4c0b-bbd3-5bed51e00c00 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:49.830883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:49.831629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b108d-de4c-45bd-9f0c-7fdf0bf2fa11 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.832167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b108d-de4c-45bd-9f0c-7fdf0bf2fa11 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.832680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2b108d-de4c-45bd-9f0c-7fdf0bf2fa11 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.834493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 439/881] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:49.840263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.840679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.841033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.855902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:49.856512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:49.856838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:49.857109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:49.857729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:49.858022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:49.859393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:49.863842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:49.871803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 443/882] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:49 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:49.872016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:49.955359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 440/883] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:49 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:50.230967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:50.335188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecd1302-692b-45c0-9a2a-b18dc846cab2 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:50.371096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:50.371790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.372069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.372334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.373003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:50.375014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:50.383893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:50.385058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:50.386307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 444/884] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 20 04:39:50 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:50.391676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:50.446001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:50.501128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a1ee-2752-410c-bd20-8143778dedd9 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:50.539573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:50.540210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.540482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.540752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.541379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:50.541677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:50.543036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140f1cf1-9caa-48d8-81ed-2b6e3dc69892 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:50.548224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 441/885] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:50 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:50.554041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:50.602357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:50.664756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f450260-378e-478a-a390-2227f55af9d6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:50.699032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:50.699616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e5bc9-daf7-42fc-b1d1-1d8b27c5c967 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.699965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.699965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.700209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.700688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e5bc9-daf7-42fc-b1d1-1d8b27c5c967 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.700794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:50.701069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:50.701498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244e5bc9-daf7-42fc-b1d1-1d8b27c5c967 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.702467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:50.704090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 442/886] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:50.708236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 445/887] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:50 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:50.709635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.709986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.710329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.718737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:50.728993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:50.730278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:50.812705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 443/888] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:50.847598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-592493c6-f9d3-47da-a882-f0bf4f30fea8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:50.850289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:50.883460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:50.884351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.884847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.885301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.886164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] RBAC: Adding query filter params (interface=public, service_id=69c13149df5f4bf49eaeded524e0e248, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:50.886650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:50.888278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59564855-df55-4c95-b4e0-0da3989612bd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:50.893855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 446/889] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:39:50 2022] GET /identity/v3/endpoints?service_id=69c13149df5f4bf49eaeded524e0e248&interface=public®ion_id=RegionOne => generated 194 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:50.899942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:50.934182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa964-428f-43bd-80aa-f55783b4f12f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.934467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa964-428f-43bd-80aa-f55783b4f12f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.934743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2fa964-428f-43bd-80aa-f55783b4f12f None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.936374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 447/890] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:50.941229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:50.941508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:50.941776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:50.951011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:50.961774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:50.962968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:51.010523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0827631-2d36-4d3d-ada0-2f07ad3cd771 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.041893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 448/891] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:50 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:51.053440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.054263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.054787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.055232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.056098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.057686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.064384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 444/892] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:39:50 2022] GET /identity/v3/services => generated 1268 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:39:51.075479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.189746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:51.194241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0026b32-ee4a-4ac0-aa1f-ead0fed2e8ee None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.238231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.239037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.239216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.239471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.251885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:51.255971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:51.256900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:39:51.257743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:51.259975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 449/893] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:51.262983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.324237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.382433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-badbf572-2310-475f-864e-a4c27160b208 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.396134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:51.441862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.442827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.443302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.443826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.444855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:51.446090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.447688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.448670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee76ef-f4a6-43f7-9800-d2869d4d83e3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.463820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 445/894] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:51.465979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.494209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.494863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.495128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.495401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.496097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.497840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:51.509995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:51.511776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:51.512638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 450/895] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:51.518623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.599521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee20b340-c811-4490-8979-d5e2925b751f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.606489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:51.645641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.645641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.645641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.646010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.658537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5402d-6585-4dfb-af6e-1618986c047e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.660685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.662126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:51.680539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:51.681563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:51.682464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:51.682464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:51.682464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:51.682464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 446/896] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:51.688473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.705846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.706756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.707208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.707648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.708513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:51.708985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.711838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.722430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 451/897] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:51.722996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:51.724348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.816748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:51.835882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2148907-83d6-40ad-acd0-54856a4f99cb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.837198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e446c55-bb56-4835-b18f-07aa2a1624d9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:51.871630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.872573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.873071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.873552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.874421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:51.874918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.876539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.881806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 452/898] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:51.886638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:51.886638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:51.886638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:51.886638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:51.886981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:51.886981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:51.886981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:51.888265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:51.901937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 447/899] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:51.907634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.013374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.029281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef36ab69-bffb-4a10-82e3-556a322220d5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.037215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bfc016-9509-425f-881c-a0e19294bd7d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.076147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.077164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.078245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.078747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.079853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] RBAC: Adding query filter params (interface=public, service_id=578af1e365e646a28e78fbc3c762031d, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:52.080432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.082557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.082960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.083637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.083933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.084205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.092146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 453/900] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/endpoints?service_id=578af1e365e646a28e78fbc3c762031d&interface=public®ion_id=RegionOne => generated 194 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:52.097171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.098301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.100189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:52.115785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:52.116808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:52.117772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:52.119139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.121904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 448/901] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:39:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:52.123349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.222811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d79d008-1916-4864-b06e-3b2b1daa879c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.253924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f68e86-5789-4917-8534-de1e6c8f88c9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.259748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.260362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.260635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.260910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.261517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.262916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3637aaa-5f2d-4a13-96ee-30df02be8895 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.269557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 454/902] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:39:52 2022] GET /identity/v3/services => generated 1268 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:39:52.270700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b56ff-6b42-4729-ae6c-01706b0a6b41 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.270987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b56ff-6b42-4729-ae6c-01706b0a6b41 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.271256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8b56ff-6b42-4729-ae6c-01706b0a6b41 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.272961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 455/903] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:52.278742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.279054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.279298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.302908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.303535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.303862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.304195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.304956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:52.305216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:52.305334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.306721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.307006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:52.323089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.327404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 449/904] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:39:52 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:52.333300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.411894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 456/905] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:52 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:52.458381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ee5ae-b995-44f6-b151-834432e764ea None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.497219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.498115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.498115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.498307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.570871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.573974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.575412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.676756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 450/906] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:39:52 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:39:52.685037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.696392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.711592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:52.812594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3c42a1-10b6-44d6-84e1-d71b0900e553 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.822695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:52.825937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1e3f85-378b-44ba-a4ad-d8c1242a1bc2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:52.855175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.855175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.855175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.855175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.864776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:52.865520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:52.867368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:52.867368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:52.867368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.868457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.869490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:52.871067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:52.889365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:52.891032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:52.891985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:52.891985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:52.891985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:52.898233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 451/908] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:39:52 2022] POST /identity/v3/services => generated 241 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:39:52.898480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 457/908] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:52.899565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:53.019460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daa4987c-de78-40c6-bfa2-5f747e31e4ea None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:53.063696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:53.064749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.065225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.065712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.066575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:53.067112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:53.068876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:53.087252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 452/909] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:53.090461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:53.156450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:53.201056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dc3472-427f-47e3-bef6-18a8df0d421a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:53.236959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:53.237589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.237866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.238136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.245145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:53.246577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4d795a67-de06-4e82-80bb-f976d5dd7da7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:53.258000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:53.258993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:53.260381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 458/910] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:53.267813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:53.291393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:53.381092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f3829-5ee2-4878-9b49-63eb4a8938ef None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:53.401252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab762-43b4-40bf-bf14-393e749a8a76 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.401553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab762-43b4-40bf-bf14-393e749a8a76 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.401799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6ab762-43b4-40bf-bf14-393e749a8a76 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.403418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 459/911] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:53.408810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.409090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.409353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.420009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:53.420912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.421434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.421930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.423368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:53.424048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:53.425816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:53.428297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:53.429653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:53.440967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 453/912] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:53.448282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:53.520279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 460/913] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:53 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:53.544629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:53.566520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984ae42f-2796-410c-aa6c-b66a6b4f1d81 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:53.600969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:53.601927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.602409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.602881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.603835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] RBAC: Adding query filter params (role.id=463dc98b4ee14465887f4f6453869565, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=51c05b0002454c93a8c2ffbd0cef784d) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:53.604375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:53.605973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:53.612382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 454/914] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:39:53 2022] GET /identity/v3/role_assignments?user.id=51c05b0002454c93a8c2ffbd0cef784d&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=463dc98b4ee14465887f4f6453869565 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:53.794824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:53.846893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:53.900050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d17b9e-7a1a-46b8-be67-a06a25f6e8cd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:53.937468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:53.938102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:53.938373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:53.938641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:53.939222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:53.940621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:53.949541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:53.950524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:53.951420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 461/915] 10.222.0.42 () {56 vars in 1132 bytes} [Tue Sep 20 04:39:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:53.959065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:54.066377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c059a7-90c1-4468-9889-790a777373f9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:54.102614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:54.103329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:54.103608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:54.103933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:54.104602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:54.104895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:54.106251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:54.112099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 455/916] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:54.117940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:54.221851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9255135-f47d-42aa-a66f-9c465a8ea29c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:54.236865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:54.257765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:54.258366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:54.258640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:54.258908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:54.259534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:54.259856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:54.261209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4412d150-ae57-4eb4-9687-02592c9fd6bf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:54.266385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 462/917] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:54 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:54.272255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:54.276330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:54.380001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3401e8-04e2-484d-91ed-926f3421f4d8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:54.415038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:54.415651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:54.415950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:54.416277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:54.416958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:54.418311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba418d0a-8dd2-4169-9dec-4e81899b3f05 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:54.443548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 456/918] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:39:54 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:54.614779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4918-8281-4f07-8d2b-4390569a95a4 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:54.615338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4918-8281-4f07-8d2b-4390569a95a4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:54.615811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a4918-8281-4f07-8d2b-4390569a95a4 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:54.617643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 463/919] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:54.623193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:54.623683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:54.623796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:54.643937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:54.645049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:54.703906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:54.721889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 457/920] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:54 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:54.989431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4918-8281-4f07-8d2b-4390569a95a4 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.092255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a4918-8281-4f07-8d2b-4390569a95a4 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:55.127428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:55.128374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.128794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.129205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.129977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:55.131552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-92778341-22a9-49c7-845e-ad7687980817 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:55.143452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:55.145325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 20 04:39:55.146694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:55.149734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 464/921] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:55.156224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.256110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d7e6-49ea-4c3d-a200-b527fdd247c8 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.256285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d7e6-49ea-4c3d-a200-b527fdd247c8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.256568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5885d7e6-49ea-4c3d-a200-b527fdd247c8 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.258231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 465/922] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:55.263192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.263864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bceecf-2ac4-4f29-8d9d-87e390d3dc32 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:55.264027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.264027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.283300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:55.284553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:55.300363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:55.300976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.301294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.301483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.302114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:55.302411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:55.303792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:55.309148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 458/923] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:55 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:55.321514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.327027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:55.366325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 466/924] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:39:55.382531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:55.439866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce5746b-ee16-4181-a141-9f5e9aa18e2b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:55.476651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:55.477400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.477681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.478008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.478647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:55.478958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:55.480411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:55.486995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 459/925] 10.222.0.42 () {56 vars in 1114 bytes} [Tue Sep 20 04:39:55 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:39:55.492575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.599843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837fd7e3-2063-4d69-8885-d66e394a268f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:55.634329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:55.634935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.635210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.635478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.636171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:55.637532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:55.664045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 467/926] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:39:55 2022] POST /identity/v3/endpoints => generated 346 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:39:55.674647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.793276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d230e0e1-cb2b-40c4-b876-ccfbcc340f17 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:55.814362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:55.849925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:55.850488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.850764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.851033 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.851612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:55.853056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-69240313-c878-4a42-aa3b-9a51021633b7 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:55.862700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:55.863713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:55.864627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 460/927] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:55 2022] GET /identity/v3/services/object-store => generated 93 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:55.869628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:55.900252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:55.918914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d2e3-34cb-4899-b9c8-815f1a208a03 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.919193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d2e3-34cb-4899-b9c8-815f1a208a03 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.919451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4429d2e3-34cb-4899-b9c8-815f1a208a03 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.920948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 461/928] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:55.926449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:55.926730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:55.927002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:55.952831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:55.954038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:55.988275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6506091-46d4-483d-a381-9c38e86779d6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.026338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.026980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.027261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.027536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.028202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:56.028505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.029878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.030390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 462/929] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:55 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:56.040296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 468/930] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:55 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:56.045729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.148821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2dcad3-60c4-4e58-a2bf-fde2ecf99c37 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.160164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:56.185022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.185998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.186522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.187555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.188436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:56.188936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.190547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.196072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 463/931] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:56.202281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.302125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:56.307603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.312068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8444ce7d-c3a1-445a-883a-9a0549d096c6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.358556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.360174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.360660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.361292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.362540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] RBAC: Adding query filter params (interface=public, service_id=0906d334611d426294f699a1b21ac708, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:56.363111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.365156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.372740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 469/932] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/endpoints?service_id=0906d334611d426294f699a1b21ac708&interface=public®ion_id=RegionOne => generated 194 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:56.378609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.421178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27062fa9-d0f8-4c05-92ec-0152fc5c9a88 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.467869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.469184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.469463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.469735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.483185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:39:56.489550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:56.490509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:56.491635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 464/933] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:56.500945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.517474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa13597-3fdd-4f02-9af8-321c20509ece None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.541278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:56.558566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.559623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.560159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.560629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.561534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.563634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.570897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 470/934] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/services => generated 1497 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:39:56.626962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad748d50-f7cf-4007-9892-6565d2d34e8f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.668510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.669160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.669445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.669711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.670550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:56.670866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.673055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed64dc12-1734-43d8-87ee-08d61b94945d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.683198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 465/935] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:56.689205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.719550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:56.783682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec339-605e-4530-8852-e31f59a8ce02 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.783995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec339-605e-4530-8852-e31f59a8ce02 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.784272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aaec339-605e-4530-8852-e31f59a8ce02 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.785840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 466/936] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:56.790780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.791057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.791325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.810099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:56.811286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:56.815716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9061bbf-4792-4ae1-be72-c3f0f826a030 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:56.859893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:56.860518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:56.860789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:56.861056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:56.873302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:56.875345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:56.890884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:56.891916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:56.892821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:56.892821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:56.892821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:56.892821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 471/937] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:56.893486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 467/938] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:56 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:56.900120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:56.977174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.011314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5377aaf0-c02f-434d-ae56-138d57c3f69e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.046591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.047560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.048076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.048551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.049406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:57.049919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.051475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.064708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 472/939] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:57.072265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.096464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.184567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dadf1-67bf-4a84-862f-3e4585f39985 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.220264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.221225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.221702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.221947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.222377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.230023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.231686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:39:57.245891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:57.246914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:39:57.247934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:57.251014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 468/940] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:57.257872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.338613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414890ad-af2f-430b-8e2b-9fa240e488bc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.363493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.370354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.378621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.379599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.380106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.380638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.381452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.383024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.387883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b98623-b48f-47c5-8f2a-4d1aec3c0e55 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:57.393624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:57.394664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:39:57.395535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:57.404859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 473/941] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/services/compute => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:57.408213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.430405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.431030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.431311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.431588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.435085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:57.435085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.438757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.466731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 469/942] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:57.467656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.554719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0585a9c8-94b4-438f-a129-1d06167a3e91 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.580017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9166f8fb-e86c-4a9d-adcd-e1ae929e4cb9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.600286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.600917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.601196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.601468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.602492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:57.602796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.604198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.615703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 474/943] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:57.618786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.625427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.626224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.626600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.627001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.635045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.640006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.641860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:39:57.659530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:57.660573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:39:57.661537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:39:57.661537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:39:57.661537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:57.666639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 470/944] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:57.670477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.707230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:57.759301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ffb592-b68c-4b30-8a70-3920287d92d6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.795700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.796656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.797085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.797501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.798268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:57.798737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.800281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.805149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc68b409-8cba-4c9b-81db-cc4e15b9901c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:57.805885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 475/945] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:57.849396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:57.850361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:57.850786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:57.851201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:57.852038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:57.852488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:57.854147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f48530-bac9-4dc0-87d9-217525865294 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:57.868641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 471/946] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:57.874023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:57.990671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8efce9-7189-46d8-8491-18a7326e7e80 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.014734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2ad1-a856-4f45-86f3-5a2cb493836b None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.015447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2ad1-a856-4f45-86f3-5a2cb493836b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.015948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d2ad1-a856-4f45-86f3-5a2cb493836b None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.017524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 472/947] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:39:58.023967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.024233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:58.024369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.024570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.040633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.041268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.041590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.041866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.048060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:58.049279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:58.052479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:58.054167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:58.066550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:58.067438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:58.068697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.070819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 476/948] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:58.076496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:58.104193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:58.133890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 473/949] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:58.199090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550eddc4-66ca-49f8-87f2-538393c6c218 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.235419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.236430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.236910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.237398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.238357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:58.238901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:58.240665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:58.253868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 477/950] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:39:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:58.259473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:58.370742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e8d57-6a94-4d6d-af3d-7e50b44fdec6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.407879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:58.409808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.410704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.411441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.411961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/51c05b0002454c93a8c2ffbd0cef784d/roles/463dc98b4ee14465887f4f6453869565` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.415289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=51c05b0002454c93a8c2ffbd0cef784d, role_id=463dc98b4ee14465887f4f6453869565)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:58.416917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:58.451781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 474/951] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:39:58 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/51c05b0002454c93a8c2ffbd0cef784d/roles/463dc98b4ee14465887f4f6453869565 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:39:58.474333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:58.540473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945663e8-6731-4605-9fdc-ee7289cdbb1e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.580095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.580972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.581406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.581838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.582728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:58.584450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:58.587347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING keystone.server.flask.common [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 20 04:39:58.610151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.sql.core [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 04:39:58.610151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 20 04:39:58.610151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [parameters: {'id': 'f3b1d601e34045b78ccbb9ec33ce1145', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 20 04:39:58.610151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-0812fd3b-3cc4-4cf2-aafb-bd7570739c64 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3b1d601e34045b78ccbb9ec33ce1145.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3b1d601e34045b78ccbb9ec33ce1145. Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:39:58.629294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result.read() Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 20 04:39:58.630159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application yield resource Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise self.value Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application session.commit() Sep 20 04:39:58.631123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.session.flush() Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application compat.raise_( Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 04:39:58.632059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 04:39:58.632997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result.read() Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:39:58.633815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [parameters: {'id': 'f3b1d601e34045b78ccbb9ec33ce1145', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.634680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:58.635476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f3b1d601e34045b78ccbb9ec33ce1145. Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:58.637813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 478/952] 10.222.0.42 () {60 vars in 1140 bytes} [Tue Sep 20 04:39:58 2022] POST /identity/v3/projects => generated 262 bytes in 223 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:39:58.645927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:58.706962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:58.776108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d820daa-1c99-46fe-af38-55709d041d4e None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.815239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.816511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.816814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.817079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.824097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:58.825901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:58.837031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccc2b7-2cd4-4d6a-9d10-1794837150ec None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.837334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccc2b7-2cd4-4d6a-9d10-1794837150ec None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.837604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ccc2b7-2cd4-4d6a-9d10-1794837150ec None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:39:58.838495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:58.839426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:39:58.840435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:39:58.842662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 475/954] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:39:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:58.843846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 479/954] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:39:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:39:58.848503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:58.853068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.853068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.853281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.873134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:39:58.874705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:39:58.951943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 480/955] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:39:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:39:58.952896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b49312d-7c0c-4fd3-b539-fcd2aba889a1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:58.954564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:58.996919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:58.997531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:58.997814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:58.998090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:58.998826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:58.999164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:59.000696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:59.018526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 476/956] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:39:58 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:59.229863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:59.261354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:59.335572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f34ba1-2f57-412c-815d-b709e0be96ce None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:59.370680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:59.371455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:59.371868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:59.372145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:59.372784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:59.374848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:39:59.384252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:39:59.385416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:39:59.386281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 481/957] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:39:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:39:59.392326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:59.504989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65542bf-7390-4fb2-88bb-529ccf06ef13 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:59.541505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:59.542116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:59.542397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:59.542673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:59.543305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:59.543609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:59.545072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:59.550266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 477/958] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:59.556018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:59.654715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:59.662113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d02de05-4375-421a-99f2-75bb3acbdca5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:59.701383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:59.701996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:59.702868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:59.703142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:59.703791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:39:59.704092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:59.705450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00e9a49-bccf-4a3a-93d7-8823dd27e8bb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:59.710899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 482/959] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:39:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:39:59.716363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:39:59.744310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:39:59.824633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7075a1a-8754-4142-a4cc-9608d7f65176 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:39:59.862092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:39:59.862982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:39:59.863412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:39:59.863876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:39:59.864731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:39:59.866253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04257346-16d2-496a-908d-7602b6bb4f6b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:39:59.890857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 478/960] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:39:59 2022] POST /identity/v3/endpoints => generated 349 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:00.129988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d92d-d800-4d54-bf59-2b6b5a9ca536 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:00.130169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d92d-d800-4d54-bf59-2b6b5a9ca536 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:00.130454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c7d92d-d800-4d54-bf59-2b6b5a9ca536 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:00.132143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 483/961] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:00.137478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272d9fe-7933-46ee-9cdc-c7f0f6fbb9ad None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:00.137756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272d9fe-7933-46ee-9cdc-c7f0f6fbb9ad None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:00.138037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e272d9fe-7933-46ee-9cdc-c7f0f6fbb9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:00.156656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e272d9fe-7933-46ee-9cdc-c7f0f6fbb9ad None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:00.157852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e272d9fe-7933-46ee-9cdc-c7f0f6fbb9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:00.233819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 479/962] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:00.508581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7d92d-d800-4d54-bf59-2b6b5a9ca536 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:00.619747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c7d92d-d800-4d54-bf59-2b6b5a9ca536 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:00.657171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:00.657787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:00.658062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:00.658333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:00.658999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:00.660393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08523fa-3609-43b0-97cf-93e64e17d642 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:00.678760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 484/963] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:40:00 2022] POST /identity/v3/services => generated 242 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:00.729839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7fc6-afe6-4727-ada4-dffbda929668 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:00.730154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7fc6-afe6-4727-ada4-dffbda929668 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:00.730388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a7fc6-afe6-4727-ada4-dffbda929668 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:00.732125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 480/964] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:00.738614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:00.738936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:00.739171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:00.761401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:00.762713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:00.779435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:00.850476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 485/965] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:00 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:01.120424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7fc6-afe6-4727-ada4-dffbda929668 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.129596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:01.226694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a7fc6-afe6-4727-ada4-dffbda929668 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.263785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.264442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.265315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.265586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.283552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-6d7f212a-1e64-45ff-a030-dd7491d77a97 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:01.288671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:01.289680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:01.290558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 481/966] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:01.295803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.384665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe0e5-835a-4c24-bf19-46dda42efccb None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.384843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe0e5-835a-4c24-bf19-46dda42efccb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.385121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0fe0e5-835a-4c24-bf19-46dda42efccb None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.387176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 482/967] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:01.392106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.392377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.392647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.399802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90548c13-15d9-42f1-994c-edaa833874c3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.412185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:01.413517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:01.448909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.449877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.450329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.450900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.451812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:01.452841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:01.454440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:01.465254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 486/968] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:01.471626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.479383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:01.486295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:01.495806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 483/969] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:01 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:01.582031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0d6bb-6876-4177-b0d7-8ab5c4b40abe None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.616728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.617630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.618081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.618545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.633737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:01.635237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:01.651462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:01.652520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:01.653444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:01.653444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:01.653444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.653444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 487/970] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:01.660615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.762976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45f24e-97a1-43f1-b89b-3bff59fc0c98 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.795561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.800732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.801610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.802084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.802549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.803385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:01.803924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:01.805607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:01.818550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 484/971] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:01.824506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:01.859400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:01.888466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:01.907055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8a6798-37c5-4a38-80a3-94f702488fb9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.938662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f80af1-eb20-43c0-81d7-3e158ff77ae1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:01.944246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.945035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.945463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.945888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.946803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:01.948420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:01.964703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.sql.core [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 04:40:01.964703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 20 04:40:01.964703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [parameters: {'user_id': '683b46d8e2d247598c14bbc6d355b6d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 20 04:40:01.964703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=87788) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result.read() Sep 20 04:40:01.973654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:40:01.974615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application yield resource Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application next(self.gen) Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.session.rollback() Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.force_reraise() Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise self.value Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application session.commit() Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 20 04:40:01.975611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._prepare_impl() Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.session.flush() Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._flush(objects) Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application compat.raise_( Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application flush_context.execute() Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rec.execute(self) Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 20 04:40:01.976559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 20 04:40:01.977612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result = self._query(query) Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application conn.query(q) Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application result.read() Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 20 04:40:01.978493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [parameters: {'user_id': '683b46d8e2d247598c14bbc6d355b6d0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:01.979357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 20 04:40:01.980439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 20 04:40:01.981793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:01.982444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:01.982444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:01.982444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:01.982444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:01.989897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:01.990384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:01.990609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 488/972] 10.222.0.42 () {60 vars in 1131 bytes} [Tue Sep 20 04:40:01 2022] POST /identity/v3/users => generated 160 bytes in 195 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:01.992350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:40:02.003375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:02.004406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:02.005396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 485/973] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:02.010805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.113446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf8a8e3-b0e7-48c1-87d7-e4724f2d5a6e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.127442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acec29e-b654-4016-9ae7-5b85eaea4bbc None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.136987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.148219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.157265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.158127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.158509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.158885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.167426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.169253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.170056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.170818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.171927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.172336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.173305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:02.173765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.175312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:40:02.182527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:02.183515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 20 04:40:02.184520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:02.189521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 489/974] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:01 2022] GET /identity/v3/users/cinder => generated 84 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:02.190428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.198351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 486/975] 10.222.0.42 () {56 vars in 1149 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:02.204156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.294093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef0a152-8b1c-45b3-b9e3-a4a3f9079b5f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.303417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b96dc85-b149-4b31-8335-0911ca3f990d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.331943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.332762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.333106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.333466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.334236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:02.334607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.336128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e28041-381d-4499-a67c-c06624327bd5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.337627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.338236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.338583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.338918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.381431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.384743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 490/976] 10.222.0.42 () {56 vars in 1101 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:02.386204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591f9a-f997-4c75-b644-11035aa4020c None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.386489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591f9a-f997-4c75-b644-11035aa4020c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.386764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a591f9a-f997-4c75-b644-11035aa4020c None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.388296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 491/977] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:02.394039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.394321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.394595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.417196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:02.419524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:02.422103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.423919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.466586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.523885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 492/978] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:02 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:02.566468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 487/979] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:40:02.572603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.684826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2907dc-027d-4724-bc51-d0453dee3791 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.721512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.722142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.722416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.722682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.733466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.734889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:02.749845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:02.750827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:02.752230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:02.752230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:02.752230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:02.752230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 493/980] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:02.756750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.813762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.833501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.838421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:02.868437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bf65ca-6171-4afb-8b93-75b9d2332e3c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.904839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.906023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.906264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.906533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.907179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:02.907484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.908873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.920066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 488/981] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:02.926026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:02.935502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c4fee-594b-42c4-98bc-23746824a27f None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:02.971365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:02.972025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.972304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.972576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.973303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:02.974521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-49e7f87b-c8e2-480b-ba88-96cd43f76a5b None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:02.983837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:02.985050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:02.986095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 494/982] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:02.987091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bd77-2efd-4415-9ba9-c6d9c7626174 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:02.987091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bd77-2efd-4415-9ba9-c6d9c7626174 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:02.987091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4627bd77-2efd-4415-9ba9-c6d9c7626174 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:02.988613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 495/983] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:02.990439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627bd77-2efd-4415-9ba9-c6d9c7626174 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.036580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-940fb30e-a27c-4b2c-b428-d0617bff3f72 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.069273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.069895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.070198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.070471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.072335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.076196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.078302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.079980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-29005073-58c7-4a42-a5a2-c1ae00eb0e68 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:40:03.091383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:03.092572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:03.094074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 489/984] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:03.094745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.094886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4627bd77-2efd-4415-9ba9-c6d9c7626174 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.095024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.095293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.113117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:03.114300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:03.131755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.132359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.132633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.132901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.133525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.133831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.135184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.144567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 496/985] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:40:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:03.144567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.184815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 490/986] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:03 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:03.186007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.242446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efc959f-873c-42f9-a3ab-b37c9c98b62d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.275445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.276068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.276346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.276617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.277302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.277604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.279022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.291429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 497/987] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:03.297732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.307632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.309579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744c8015-2a66-483b-b351-73ded364a9ec None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.339316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.352646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.353044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.353323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.353610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.354212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.354513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.355901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.366256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 491/988] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:03.367392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.398650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db63c4-f201-4456-8b1d-9fd82dd32348 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.434548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.435603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.436092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.436312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.437575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] RBAC: Adding query filter params (role.id=463dc98b4ee14465887f4f6453869565, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=51c05b0002454c93a8c2ffbd0cef784d) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.437881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.441400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.446765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 498/989] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/role_assignments?user.id=51c05b0002454c93a8c2ffbd0cef784d&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=463dc98b4ee14465887f4f6453869565 => generated 608 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:03.454341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.476921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9cf11e-2702-4999-887c-c510f8f64dd8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.517295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.518094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.518401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.518694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.519426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] RBAC: Adding query filter params (interface=admin, service_id=0906d334611d426294f699a1b21ac708, region_id=RegionOne) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.519756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.521469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.534356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 492/990] 10.222.0.42 () {56 vars in 1249 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/endpoints?service_id=0906d334611d426294f699a1b21ac708&interface=admin®ion_id=RegionOne => generated 193 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:03.536749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.541274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.578575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fa7dcb2-0a40-420c-96b5-59e66a05ecfd None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.601848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.616188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.617386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.617667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.617934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.619025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.620411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:03.630096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:03.631155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:03.632116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:03.632880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 499/991] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/services/compute => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:03.640617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.662006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6a1fdb-6a36-4479-b531-8e82d689adc5 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.699265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.699819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.700101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.700368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.701023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.703399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.720037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 493/992] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/services => generated 1727 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:40:03.754236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481ec19b-8198-4325-8148-833d961433f8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.792478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.793180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.793476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.793750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.794394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.794695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.796748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.798981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.803702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 500/993] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:03.809140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:03.917283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0e1d86-76a4-46b7-817d-8f752e11f89d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:03.934416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:03.953644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:03.954171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:03.954443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:03.954707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:03.955330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:03.955623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:03.957010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:03.966564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 494/994] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:03.968726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:04.075765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aebb3da-b3a5-46da-ac6b-207eef019495 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:04.111275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:04.111906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:04.112186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:04.112457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:04.113146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] RBAC: Adding query filter params (interface=public, service_id=4d25c5c737da4238948f20da372ed5d8, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:04.113454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:04.114811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e07104-a0f2-42f1-a7da-f53edb8d5cca None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:04.119981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 501/995] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:40:03 2022] GET /identity/v3/endpoints?service_id=4d25c5c737da4238948f20da372ed5d8&interface=public®ion_id=RegionOne => generated 194 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:04.125573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:04.225128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9305ea1c-ce4f-4ac1-89f7-579ac32f8bb9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:04.259154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:04.259797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:04.260078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:04.260347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:04.260954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:04.262310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b61eef-ada2-4206-9f47-c8ad6e669b35 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:04.268662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 495/996] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:40:04 2022] GET /identity/v3/services => generated 1727 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:40:05.656648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968adc54-3f49-42e9-8268-8ee5a5b9c9bd None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:05.657270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968adc54-3f49-42e9-8268-8ee5a5b9c9bd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:05.657270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968adc54-3f49-42e9-8268-8ee5a5b9c9bd None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:05.658655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 502/997] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:05.663550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734fa8a-a62e-409e-a7ff-5281167110e2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:05.663977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734fa8a-a62e-409e-a7ff-5281167110e2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:05.664150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c734fa8a-a62e-409e-a7ff-5281167110e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:05.682131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c734fa8a-a62e-409e-a7ff-5281167110e2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:05.683325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c734fa8a-a62e-409e-a7ff-5281167110e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:05.723333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:05.751846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 496/998] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:05.877441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f23c-74fd-4a52-bfab-1bed6ef50e2a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:05.877822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f23c-74fd-4a52-bfab-1bed6ef50e2a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:05.877999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df5f23c-74fd-4a52-bfab-1bed6ef50e2a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:05.879465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 503/999] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:05.884649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:05.884955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:05.885227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:05.903636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:05.904851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:05.973702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 497/1000] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:05 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:06.026394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5f23c-74fd-4a52-bfab-1bed6ef50e2a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.092707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:06.135716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df5f23c-74fd-4a52-bfab-1bed6ef50e2a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.171663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.172324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.172602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.172874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] PATH_INFO: `/v3/services/image` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.173451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.174816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:06.183525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:06.188003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.188913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 504/1001] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services/image => generated 86 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:06.190857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.239764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.293515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23710aad-62af-4ceb-88a5-eacf76b920df None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.296743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:06.338607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.339216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.339503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.341539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.341539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] RBAC: Adding query filter params (name=image) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:06.341539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.342071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.346991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 498/1002] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:06.347110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6db5f6-20da-4b3d-8d87-42dcae8d6407 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.352330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.373567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:06.382971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.383605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.383914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.384192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] PATH_INFO: `/v3/services/object-store` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.384777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.386145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:06.395445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:06.401709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:06.402596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 505/1003] 10.222.0.42 () {56 vars in 1126 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:06.403426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.465921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e033db7b-bf4b-4262-bfc1-b4e7e1fb93c0 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.501709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.502240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.502519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.502791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.503418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] RBAC: Adding query filter params (type=image) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:06.503715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.505135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b8d32-105d-42ff-807e-fc9f201995dc None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.507223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5cc932-d1d0-42f6-ba8c-cbadaa995bcd None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.509450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 499/1004] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services?type=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:06.510581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c7af-44bb-413b-9020-a485806fb7b4 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.510863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c7af-44bb-413b-9020-a485806fb7b4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.511135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd3c7af-44bb-413b-9020-a485806fb7b4 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.512401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 500/1005] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:06 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:06.525486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.525809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.526103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.546807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.547442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.547709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:06.547853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.548048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.548658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:06.548946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:06.549044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.550341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.560946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 506/1006] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:06.563052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.586287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:06.630326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:06.633513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 501/1007] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:06 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:06.681920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fa0787b-29fb-4f85-b57e-360690823e1c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.717524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.718156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.718430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.718695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.719312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:06.719607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.720995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.729521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 507/1008] 10.222.0.42 () {56 vars in 1122 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:06.732144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:06.831956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5aa7e-2770-425d-b9ab-86b39fcf9d5a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:06.865058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:06.865658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:06.865927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:06.866191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:06.866856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:06.868225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:06.884615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 502/1009] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:40:06 2022] POST /identity/v3/endpoints => generated 325 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:06.903695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:07.011187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812ef3df-184f-4bfb-880e-d1896e2282d5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:07.033410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:07.056226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:07.056865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:07.057136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:07.057399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] PATH_INFO: `/v3/services/compute` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:07.058005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:07.059363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:07.069684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:07.071941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:07.072923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 508/1010] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:06 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:07.077691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:07.104879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:07.185867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a4201d-e7ef-4388-bf11-db6e9ca590a1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:07.219116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:07.219721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:07.220019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:07.220288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:07.220915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:07.221212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:07.222566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:07.227503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 503/1011] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:40:07 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:07.232974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:07.333843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d7dcf8-5d94-4e1b-abe7-3c8e97419f16 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:07.367523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:07.368090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:07.368367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:07.368635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:07.369255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] RBAC: Adding query filter params (type=compute) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:07.369551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:07.370900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24594a79-ba09-4b5c-aa11-f92962ecc605 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:07.380980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 509/1012] 10.222.0.42 () {56 vars in 1112 bytes} [Tue Sep 20 04:40:07 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:07.382171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:07.481255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:07.497118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbaef0a3-0329-4166-a2db-6ab0004967b3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:07.530863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:07.531461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:07.531768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:07.532023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:07.532679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:07.534045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a2024c-ebab-43e8-8ca9-e73d01bafb50 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:07.554768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 504/1013] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:40:07 2022] POST /identity/v3/endpoints => generated 334 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:08.689117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1c82-615a-4350-8b97-46d93aeb0775 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:08.689638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1c82-615a-4350-8b97-46d93aeb0775 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:08.689750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6e1c82-615a-4350-8b97-46d93aeb0775 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:08.691044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 510/1014] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:08.696403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cbb0-796b-48a9-8410-489888d8a991 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:08.696794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cbb0-796b-48a9-8410-489888d8a991 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:08.696954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9619cbb0-796b-48a9-8410-489888d8a991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:08.715503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9619cbb0-796b-48a9-8410-489888d8a991 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:08.716719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9619cbb0-796b-48a9-8410-489888d8a991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:08.789515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 505/1015] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:08 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:09.054592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1c82-615a-4350-8b97-46d93aeb0775 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:09.103432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:09.126069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc65bf-b583-4f19-b357-35f5065bff9b None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.126354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc65bf-b583-4f19-b357-35f5065bff9b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.126648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fc65bf-b583-4f19-b357-35f5065bff9b None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.128130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 506/1016] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:40:09.132784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.133053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.133321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.152329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:09.153501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:09.162689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6e1c82-615a-4350-8b97-46d93aeb0775 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:09.197829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:09.198776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.199060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.199328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.200016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:09.201682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:09.217345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 511/1017] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:40:09 2022] POST /identity/v3/services => generated 242 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:09.224831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:09.240209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 507/1018] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:09.512221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:09.615361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ee6865-8c4e-4b82-8c79-a585e56798d3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:09.617847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:09.652866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:09.653495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.653772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.654041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.655177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:09.656633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e83d510-55e1-4897-98f6-8e8801cfa866 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:09.658373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 512/1019] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:09.664124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:09.769464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c307bc47-3b09-41ba-8741-303f4f435fb0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:09.794787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e071ee5-99f2-447b-bd1e-da5cc34d032d None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.795316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e071ee5-99f2-447b-bd1e-da5cc34d032d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.795316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e071ee5-99f2-447b-bd1e-da5cc34d032d None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.797199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 513/1020] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:40:09.802042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.802322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.802591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.804834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:09.805453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:09.805728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:09.805997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:09.806655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:09.808092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:09.821105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:09.822357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:09.847757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 508/1021] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:40:09 2022] POST /identity/v3/projects => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:09.906440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 514/1022] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:09 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:10.175796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:10.235701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:10.297890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b67a174-0aad-473e-aefd-6f961b6909cf None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:10.331802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:10.332443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:10.332721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:10.332990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:10.344288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:10.349160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:10.350116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:10.351003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:10.355597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 509/1023] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:40:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:10.356659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:10.466724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ea864-b473-42ce-b256-e1ce8d2590f1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:10.468857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:10.509269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:10.511348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:10.514942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:10.515476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:10.516778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:10.517635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:10.520157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:10.531083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 515/1024] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:40:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:10.536500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:10.652768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0849eb8-40f0-400c-848e-78f5110bfa17 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:10.660385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:10.689572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:10.690524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:10.691010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:10.691487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:10.702383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:10.704163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:10.718806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:10.719776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:10.720713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:10.720713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:10.720713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:10.721379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 510/1025] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:10.726658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:10.834301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d830f-9f19-4e17-9aad-18a1e65ce1fc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:10.866951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:10.867555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:10.867870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:10.868148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:10.868784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:10.869086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:10.870450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:10.884150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 516/1026] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:10.891651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:10.990465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa87170-c9d5-4fc8-8ff4-143ae857a2d1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.024668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.025303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.025584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.025860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.033405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.034841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:40:11.045807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:11.046753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:11.048149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:11.051723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 511/1027] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:40:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:11.053158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.079229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.158750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2caff798-0000-4e24-8f57-7cc36db7fbb9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.193530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.194129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.194402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.194668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.195380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:11.195678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.197117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6446f4c9-2002-48ba-b633-f964e652d07c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.219605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 517/1028] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:11.220907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.239877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.322069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27941707-ecb4-4e50-9079-b977a7ced1c2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.357537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.358179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.358455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.358721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.425555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.427051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.428503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861359-1953-4dcc-9619-1ac7bf07f059 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.428793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861359-1953-4dcc-9619-1ac7bf07f059 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.429067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74861359-1953-4dcc-9619-1ac7bf07f059 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.430422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 518/1029] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:11.441387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.441387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.441387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.452056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.458273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:11.459704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:11.531766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 519/1030] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:11 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:11.543777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 512/1031] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:11.547544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.561604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.644378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775f0613-6c5c-42f2-a78d-86ba2f4fcf64 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.678330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.678951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.679232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.679496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.689317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.690744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:11.704934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:11.705903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:11.706970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:11.706970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:11.706970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:11.706970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 520/1032] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:11.711614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.809698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76812c99-5303-4e70-833b-be0f1b2cab87 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.814526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.828215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.846964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.847906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.848185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.848455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.849086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:11.849382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.850726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.862545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 513/1033] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:11.867660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:11.884952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:11.926417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d4c0a-f8bf-4d3b-beb1-431205892733 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.964234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:11.965419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:11.966019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:11.966351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] PATH_INFO: `/v3/services/image` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:11.966967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:11.968597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:11.975103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92551a3-aff3-4cc7-8d62-65fa1c6567db None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:11.979218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:11.984159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:11.985117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 521/1034] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/services/image => generated 86 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:11.987121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.015820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.016457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.016734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.017008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.024541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.026149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:40:12.039337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:12.040310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:12.041270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 514/1035] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:12.046736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.092738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.097124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d82fc40-f465-4049-8b9e-d10e9382a5ee None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.123720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.132683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.133285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.133564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.133842 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.134462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] RBAC: Adding query filter params (name=image) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:12.134764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.136144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8d2abe-3f06-4411-8737-cd663cdaa80e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.141330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 522/1036] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:11 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:12.142512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c6f7-c2ba-412e-be2e-44ae22f36bd0 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.142796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c6f7-c2ba-412e-be2e-44ae22f36bd0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.143067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06c6f7-c2ba-412e-be2e-44ae22f36bd0 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.147279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 523/1037] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:12.147422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06c6f7-c2ba-412e-be2e-44ae22f36bd0 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.159224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5166ad2e-6efc-4e9e-b72f-69a3276e6b83 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.196743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe794b88-d836-4797-97a0-9774257950da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.198744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794b88-d836-4797-97a0-9774257950da None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.199032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794b88-d836-4797-97a0-9774257950da None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.199305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe794b88-d836-4797-97a0-9774257950da None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.200027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794b88-d836-4797-97a0-9774257950da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:12.200329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794b88-d836-4797-97a0-9774257950da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.204286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe794b88-d836-4797-97a0-9774257950da None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.216387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 515/1038] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:12.216387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.216387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.216387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.236010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:12.237213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:12.252973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06c6f7-c2ba-412e-be2e-44ae22f36bd0 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.286840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.287439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.287715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.288019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.288642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] RBAC: Adding query filter params (type=image) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:12.288944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.290302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.295010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 524/1039] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:12.295828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.302627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 516/1040] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:12 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:12.303322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.332024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.361786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.407288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51337350-0e0c-4d9c-a4ec-51cd9ed9ec08 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.417728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc6123b8-252b-42ac-af41-dc6b57f8edc3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.443855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.444666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.445100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.445518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.446392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] RBAC: Adding query filter params (role.id=463dc98b4ee14465887f4f6453869565, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:12.446701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.448209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.460092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 525/1041] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=463dc98b4ee14465887f4f6453869565 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:12.463993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.464628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.464905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.465174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] PATH_INFO: `/v3/endpoints` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.465896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] RBAC: Adding query filter params (interface=public, service_id=afde8b8ad9dc4ce99d59609eaaa22fd2, region_id=RegionOne) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:12.466204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.468194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.479790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 517/1042] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/endpoints?service_id=afde8b8ad9dc4ce99d59609eaaa22fd2&interface=public®ion_id=RegionOne => generated 194 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:12.480766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.581678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.596146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb4f029-b4bb-4ea0-bd01-7538574d9c93 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.619949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.636841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.638086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.638671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.639101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.640362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.641718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.656171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 526/1043] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/services => generated 1957 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:40:12.695959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:12.706464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac74026d-f502-46e1-909e-df26b303d2ed None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.745860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.746514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.746794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.747065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.748250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.750273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249c7b51-f88b-4cc2-b037-09d42208eae8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.752081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 518/1044] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:12 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:12.757744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:12.871970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb1a8b9-2436-4c2d-90ed-00002f445c22 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:12.906568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:12.907224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:12.907498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:12.907794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:12.908456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:12.909873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31df1699-6741-4089-ba87-ab0f455fc137 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:12.935754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 527/1045] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:40:12 2022] POST /identity/v3/users => generated 285 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:14.632161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644d0c-663f-4dfd-97df-0e8893401ca3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:14.632683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644d0c-663f-4dfd-97df-0e8893401ca3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:14.632790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17644d0c-663f-4dfd-97df-0e8893401ca3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:14.634189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 519/1046] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:14.639290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dd415-439b-4bea-9bd3-2ba7eee5765e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:14.639695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dd415-439b-4bea-9bd3-2ba7eee5765e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:14.639901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15dd415-439b-4bea-9bd3-2ba7eee5765e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:14.659096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f15dd415-439b-4bea-9bd3-2ba7eee5765e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:14.660307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f15dd415-439b-4bea-9bd3-2ba7eee5765e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:14.695595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:14.735769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 528/1047] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:14.822673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c84a-dc9e-4963-9ee0-b898391ba013 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:14.822989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c84a-dc9e-4963-9ee0-b898391ba013 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:14.823215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8c84a-dc9e-4963-9ee0-b898391ba013 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:14.824743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 520/1048] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:14.830196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1919d-62f0-40db-a1d7-d28ddcbe2c72 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:14.830481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1919d-62f0-40db-a1d7-d28ddcbe2c72 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:14.830748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd1919d-62f0-40db-a1d7-d28ddcbe2c72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:14.849115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8cd1919d-62f0-40db-a1d7-d28ddcbe2c72 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:14.850287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8cd1919d-62f0-40db-a1d7-d28ddcbe2c72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:14.918288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 529/1049] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:15.002224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8c84a-dc9e-4963-9ee0-b898391ba013 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.117345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8c84a-dc9e-4963-9ee0-b898391ba013 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.150518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3aac-f233-4735-837f-94e165247fc3 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.150840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3aac-f233-4735-837f-94e165247fc3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.151065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2e3aac-f233-4735-837f-94e165247fc3 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.152560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 530/1050] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:40:15.153395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.154086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.154371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.154643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.158006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.158288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.158554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.167166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:15.172515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:15.173625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:15.174521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 521/1051] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:15.179365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.179799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:15.181072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:15.201558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.248143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 531/1052] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:15 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:15.249008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.277710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.283290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02d2bcd-f415-42e3-9b65-81eec892169b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.319719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.320443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.320738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.321093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.321744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:15.322038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.323378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.332623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 522/1053] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:15.338240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.359539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87729112-c46d-415f-afe3-c95e4d9fb8cf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.396449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.397445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.397723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.398105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] PATH_INFO: `/v3/services/image` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.398684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.400065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:15.409929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:15.410950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:15.411858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 532/1054] 10.222.0.42 () {56 vars in 1105 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:15.418829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.421570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.451201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e43c2f-c6f6-4f8e-a27e-d9c59702b915 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.491847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.492476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.492754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.493024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.505442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.506874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.518767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:15.522634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:15.523591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:15.525135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:15.525135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:15.525135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:15.525135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 523/1055] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:15.525135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.526925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5178cdce-f707-4194-963c-fc4978e24246 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.561449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.561980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.562261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.562531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.563159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] RBAC: Adding query filter params (name=image) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:15.563460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.564870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.569698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 533/1056] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:15.570313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.628629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24a65e0-5710-4b63-9738-3f9143c7f13c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.661637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.662247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.662523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.662794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.664600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.666605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b9e550-7f07-446d-a4c2-bf2d28333b81 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.675173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:15.680008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:15.680962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:15.681818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 524/1057] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:15.682545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.706060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.706669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.706947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.707219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.707890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:15.708193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.709579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.721433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 534/1058] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:15.722213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.740332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.784223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2625be-b19d-443f-bcac-8f146be804b8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.820174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.820356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1f3330-5939-4315-aac2-10e88ace99c8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.820715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.820995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.821267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.821906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] RBAC: Adding query filter params (type=image) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:15.822212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.824855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.830101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 525/1059] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:15.830903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.857245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.857848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.858632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.858900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.859555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:15.859889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.861241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.869061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 535/1060] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:15.869821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:15.892291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.933843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3fbfbb7-cca0-48be-af1f-50408319be1b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.950138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:15.967559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:15.968214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:15.968496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:15.968769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:15.968948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb8de30-192e-4a74-aa99-0e605125054a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:15.976129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:15.977555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:40:15.989058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:15.990100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 526/1061] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:15.991442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.004073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.004737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.005018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.005295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.005973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.007319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.027100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 536/1062] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:40:15 2022] POST /identity/v3/endpoints => generated 327 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:16.028015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.106936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65642498-1963-4092-818f-6c05ad9b8c90 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.127366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.149472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda4a1d4-d8ef-470b-94d9-6cc87c1a831d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.155179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.155847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.156121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.156386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] PATH_INFO: `/v3/users/81e66960d00d4cddbf352af07d986d90` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.173437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] RBAC: Authorizing `identity:get_user(user_id=81e66960d00d4cddbf352af07d986d90)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.174946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.182189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.183168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 527/1063] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:15 2022] GET /identity/v3/users/81e66960d00d4cddbf352af07d986d90 => generated 285 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:16.184158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.188665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.189332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.189794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.190223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.191143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:16.191529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.193064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.212264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 537/1064] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:16.218217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.303947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdafde3b-a46b-4381-8423-f5ecaa30ecd3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.322279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2923de-1690-421b-a0bb-c3daaea6d920 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.341206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.341818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.342091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.343015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.357187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.357754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.358577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.358867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.368792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.370239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:16.384688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:16.385886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:16.387116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:16.387116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:16.387116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:16.387911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 538/1065] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:16.389758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.391485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.421308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.422567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.449868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.507362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e2359-f251-4182-ace9-03d5e46ade17 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.532691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 528/1066] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:16.540876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.543073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.543687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.544019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.544268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.544911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:16.545210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.546632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.558742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 539/1067] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:16.564157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.624744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.657533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0200e8-21a6-4574-aa31-97936e4d9260 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.671707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b412b15e-c488-4ee2-8d12-21b7d6f82ab9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.673246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:16.697970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.698637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.698917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.699193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.700342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.702447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.707889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 529/1068] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:16.710301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.712572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.713476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.714697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.714976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.723106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.724688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:40:16.736622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:16.737735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:16.738655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 540/1069] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:16.743840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.819939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596257be-6624-4a1d-87b9-e1ac99945206 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.847809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd181cdf-acad-4c91-bdf8-bd219ca3b7f1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:16.856787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.857513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.857794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.858623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.859481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=5311935cd5af4102b5ccb580722cc10a, user.id=81e66960d00d4cddbf352af07d986d90) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:16.859808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.861229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.867320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 530/1070] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/role_assignments?user.id=81e66960d00d4cddbf352af07d986d90&scope.project.id=5311935cd5af4102b5ccb580722cc10a&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:16.882400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:16.882946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:16.883221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:16.883490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:16.884238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:16.884545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:16.886026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9462e2e-ea9d-4dad-8562-4e0eb460aeb7 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:16.899569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 541/1071] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:40:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:16.905918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:16.909911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:17.018618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d6a5d-abf4-4bfa-a37f-cacef6420962 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:17.054054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:17.054716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:17.054996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:17.055272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/463dc98b4ee14465887f4f6453869565` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:17.057558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=697f2e9daa334a068f10a5ba0671aed6, role_id=463dc98b4ee14465887f4f6453869565)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:17.058981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6d1e86-7eb3-4ec2-b78f-66b30e78846a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:17.073160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 531/1072] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:40:16 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/697f2e9daa334a068f10a5ba0671aed6/roles/463dc98b4ee14465887f4f6453869565 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:40:18.209931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3fa7-bcff-4090-b84d-cb5c23bd75aa None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:18.211916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3fa7-bcff-4090-b84d-cb5c23bd75aa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:18.211916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1b3fa7-bcff-4090-b84d-cb5c23bd75aa None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:18.212263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 542/1073] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:18.218946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:18.219396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:18.219487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:18.238499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:18.239676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:18.300839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:18.310712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 532/1074] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:18.579247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3fa7-bcff-4090-b84d-cb5c23bd75aa None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:18.603801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:18.684913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1b3fa7-bcff-4090-b84d-cb5c23bd75aa None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:18.718432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:18.719042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:18.719321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:18.719590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:18.786501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:18.787976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1382c265-80f2-485f-9d1d-369d72076fff None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:18.810892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:18.892067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 543/1075] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:18.893360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:18.995078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317d1b83-e980-49bd-920a-8de79b39ccb6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.027487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5a61-75a1-4c69-a17e-174d049c56fe None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.027912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5a61-75a1-4c69-a17e-174d049c56fe None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.028302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fd5a61-75a1-4c69-a17e-174d049c56fe None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.029616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.029748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 544/1076] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:40:19.031101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.031382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.031653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.035104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1be0e-4e45-4d95-9e07-f488eab8e40b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.035796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1be0e-4e45-4d95-9e07-f488eab8e40b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.036098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d1be0e-4e45-4d95-9e07-f488eab8e40b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.042946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:19.044453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:19.055917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-13d1be0e-4e45-4d95-9e07-f488eab8e40b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:19.057125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-13d1be0e-4e45-4d95-9e07-f488eab8e40b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:19.059928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:19.060954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:19.064913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:19.064913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:19.064913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:19.064913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 533/1077] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:19.066788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.121012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.132452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 545/1078] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:19.182127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e96858f-c2f3-4069-a684-5f69b503385d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.216439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.217048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.217366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.217639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.218278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:19.218577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:19.219957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb64239-3359-495f-aad8-3f1afe2b1bb1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:19.236011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 534/1079] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:19.236216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895733-6a63-486a-aff5-80ebcbe8a1c9 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.236216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895733-6a63-486a-aff5-80ebcbe8a1c9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.236216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51895733-6a63-486a-aff5-80ebcbe8a1c9 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.236216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 546/1080] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:40:19.239703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.240010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.240283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.260276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:19.261509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:19.335769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 535/1081] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:19.401965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51895733-6a63-486a-aff5-80ebcbe8a1c9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.460590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.511345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51895733-6a63-486a-aff5-80ebcbe8a1c9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.547413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.548093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.548378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.548647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.567176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:19.572107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:19.573049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:19.574065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 547/1082] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:19.579363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.604449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.614195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.677509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c833d04f-23f2-40c3-988c-22097ee20369 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.703425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-452fc44e-91a2-46c6-8715-e60821341e98 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.710668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.711269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.711549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.711850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.712513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:19.712820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:19.714182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:19.716485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.722218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 536/1083] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:19.727988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.738875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.739496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.739795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.740063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.750565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:19.755361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:19.756423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:19.757278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 548/1084] 10.222.0.42 () {56 vars in 1120 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:19.762280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.824625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.828950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce42539-f56d-439a-a67c-93834ac7eefd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.860135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d38bb9-03b6-4e78-92be-58adf583b656 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:19.862273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.862894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.863167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.863434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] PATH_INFO: `/v3/users/81e66960d00d4cddbf352af07d986d90` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.864590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] RBAC: Authorizing `identity:get_user(user_id=81e66960d00d4cddbf352af07d986d90)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:19.866013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:19.867568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 537/1085] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/users/81e66960d00d4cddbf352af07d986d90 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:19.873191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.892596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:19.893207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:19.893465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:19.893731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:19.894383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:19.894674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:19.896047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:19.909106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 549/1086] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:19.910020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:19.942896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:19.971158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44b84d5-98e2-4844-9438-e11b3288a835 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.003641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.004284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.004557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.004826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.005930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.007039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a798ff-c7b3-467f-a243-21cce4924ea6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.007336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.009123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 538/1087] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:20.014807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.040388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.041012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.041290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.041558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.049025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:20.052538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.053970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:20.068324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:20.069455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:20.070407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:20.070407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:20.070407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:20.070407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 550/1088] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:20.075370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.116985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de9e765-1aa4-4923-aee2-2c69f58b85e4 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.150483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.151211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.151496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.151800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a/users/81e66960d00d4cddbf352af07d986d90/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.153731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] RBAC: Authorizing `identity:create_grant(project_id=5311935cd5af4102b5ccb580722cc10a, user_id=81e66960d00d4cddbf352af07d986d90, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.155342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.160247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:20.168641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 539/1089] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:40:20 2022] PUT /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a/users/81e66960d00d4cddbf352af07d986d90/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:40:20.175936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7f5f5c-69dd-46b4-acad-5efb9b8e9553 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.212860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.213481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.213757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.214026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.214669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:20.214966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.216420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.235123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 551/1090] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:20.236622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.336410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:20.345133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44adbf7-3bd0-44d0-a177-dcd562b4e66f None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.378688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.379313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.379586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.379884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] PATH_INFO: `/v3/users/nova` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.387134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.388579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:40:20.400076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:20.401205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:20.402556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 540/1091] 10.222.0.42 () {56 vars in 1093 bytes} [Tue Sep 20 04:40:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:20.407452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.506992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a460bf-2937-49b8-b321-15a7f869a317 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.541812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.542419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.542698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.542970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.543694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:20.544028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.545460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.563439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 552/1092] 10.222.0.42 () {56 vars in 1133 bytes} [Tue Sep 20 04:40:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:20.570345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.675655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79eb0de-5cde-4579-b2de-65c666e4349d None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:20.708536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:20.709129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:20.709400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:20.709663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:20.732771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:20.775468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:20.776879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:20.871150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 541/1093] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:40:20.877013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:20.880821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:20.975975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6fbac7-f1d9-4819-a28d-bdacfc146666 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:21.008526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:21.009143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:21.009419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:21.009688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:21.020014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:21.021441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:21.037910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:21.038924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:40:21.039873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:21.039873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:40:21.039873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:21.039873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 553/1094] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:21.044949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:21.098924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:21.142384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1e30f1-6593-4b9a-b02e-12d951de0a46 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:21.174722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:21.175310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:21.175581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:21.175884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:21.176510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:21.176803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:21.178146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:21.189315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 542/1095] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:40:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:21.194840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:21.248120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:21.293760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f48c3f-2871-4e68-9ff2-2667e2ded3dc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:21.325552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:21.326169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:21.326443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:21.327286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:21.333576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:21.335019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:40:21.345832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:21.346891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:40:21.348155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:21.351744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 554/1096] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:40:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:40:21.352748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:21.449423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e137be-ec4b-4e67-b3e4-7fac5ec94fe9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:21.463161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:21.483944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:21.484539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:21.484809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:21.485072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:21.485750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:21.486044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:21.487450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7136ca-561e-40d7-9cae-b3be236af406 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:21.499270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 543/1097] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:40:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:21.505205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:21.601298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a93fff2-72c2-4327-9957-4683559e7075 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:21.616764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:21.634082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:21.634731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:21.635010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:21.635304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:21.636046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] RBAC: Adding query filter params (role.id=463dc98b4ee14465887f4f6453869565, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=697f2e9daa334a068f10a5ba0671aed6) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:21.636351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:21.637768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a23224-645a-4ddb-b49b-bd4f70278f16 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:21.643302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 555/1098] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:21 2022] GET /identity/v3/role_assignments?user.id=697f2e9daa334a068f10a5ba0671aed6&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=463dc98b4ee14465887f4f6453869565 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:22.315026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f9cd-a5e2-4b82-bc0c-ae6fb7c93de7 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:22.315309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f9cd-a5e2-4b82-bc0c-ae6fb7c93de7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:22.315581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7f9cd-a5e2-4b82-bc0c-ae6fb7c93de7 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:22.316952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 544/1099] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:22.322450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:22.322733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:22.323008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:22.342035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:22.343214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:22.410180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 556/1100] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:22.675712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7f9cd-a5e2-4b82-bc0c-ae6fb7c93de7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:22.772605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7f9cd-a5e2-4b82-bc0c-ae6fb7c93de7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:22.804895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:22.805498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:22.805770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:22.806035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:22.815982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:22.820643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:22.821746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:22.822650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 545/1101] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:22.828257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:22.921408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3764cd1-7ac7-4468-9a06-985c0bef4355 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:22.932221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:22.957164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:22.957916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:22.958200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:22.958474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:22.959132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:22.959435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:22.961354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:22.970233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 557/1102] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:22.976135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:23.009310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:23.073736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdaa2a0-405f-4f8d-8292-5025f3ccd471 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:23.106627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:23.107236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:23.107536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:23.107879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] PATH_INFO: `/v3/users/81e66960d00d4cddbf352af07d986d90` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:23.109025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] RBAC: Authorizing `identity:get_user(user_id=81e66960d00d4cddbf352af07d986d90)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:23.110434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:23.112014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 546/1103] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:22 2022] GET /identity/v3/users/81e66960d00d4cddbf352af07d986d90 => generated 285 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:23.117713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:23.213859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c06a04f-eeb6-4622-be35-cbe89d3a53fb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:23.246816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:23.247409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:23.247683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:23.247982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:23.290646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:23.316984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:23.318418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:23.411320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 558/1104] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:23 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:23.417249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:23.513124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc95c8f8-cf50-4c9f-9d1e-a396ef858a82 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:23.514558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:23.548146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:23.548760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:23.549042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:23.549312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:23.550413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:23.551858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a97442-7400-4d2d-b635-661ddf44f50a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:23.553457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 547/1105] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:23 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:23.559523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:23.626322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:23.655344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df98524-e97d-4512-bdfb-4b4eb652186e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:23.688087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:23.688678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:23.688954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:23.689225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:23.689936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=5311935cd5af4102b5ccb580722cc10a, user.id=81e66960d00d4cddbf352af07d986d90) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:23.690238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:23.691649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea68dc5-de74-48be-bef3-dba158cc3c6e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:23.697253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 559/1106] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:23 2022] GET /identity/v3/role_assignments?user.id=81e66960d00d4cddbf352af07d986d90&scope.project.id=5311935cd5af4102b5ccb580722cc10a&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:25.819910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f0e7-861e-428d-8b73-59d920f36f19 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:25.820443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f0e7-861e-428d-8b73-59d920f36f19 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:25.820443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd75f0e7-861e-428d-8b73-59d920f36f19 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:25.821753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 548/1107] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:25.827770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:25.828211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:25.828304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:25.846723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:25.847940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:25.913018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 560/1108] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:26.180541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75f0e7-861e-428d-8b73-59d920f36f19 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:26.281187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd75f0e7-861e-428d-8b73-59d920f36f19 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:26.312534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:26.313138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:26.313411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:26.313678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:26.314758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:26.316200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3366c148-9a2a-4522-99dd-3b6f873bbbf4 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:26.317729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 549/1109] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:26.323464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:26.385932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:26.421207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97c5dc8-04c5-483f-bd35-08f7a44a380a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:26.454063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:26.454670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:26.454955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:26.455229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:26.455921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:26.457347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928dc56b-c4eb-4d80-bbab-18a123d5d55b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:26.477822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 561/1110] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:40:26 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:40:28.655418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeffe-ca6b-4ebc-a4da-9b5241d79b98 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:28.655964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeffe-ca6b-4ebc-a4da-9b5241d79b98 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:28.655964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7aeffe-ca6b-4ebc-a4da-9b5241d79b98 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:28.657312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 550/1111] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:28.662463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:28.662877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:28.663011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:28.682163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:28.683338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:28.746953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 562/1112] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:29.014714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aeffe-ca6b-4ebc-a4da-9b5241d79b98 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:29.054647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:29.113129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7aeffe-ca6b-4ebc-a4da-9b5241d79b98 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:29.145491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:29.146098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:29.146372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:29.146638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] PATH_INFO: `/v3/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:29.148276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] RBAC: Authorizing `identity:get_role(role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:29.149626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:29.150906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 551/1113] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:29 2022] GET /identity/v3/roles/7da111f273124548ab0a4deafd90a54f => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:29.157255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:29.207665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:29.252704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7d10cd-de54-4e37-9f2e-9b5ebd7445e2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:29.285653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:29.286208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:29.286482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:29.286748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] PATH_INFO: `/v3/users/db920ec6e466426aa9aea615fbd6db70` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:29.299283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] RBAC: Authorizing `identity:get_user(user_id=db920ec6e466426aa9aea615fbd6db70)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:29.300726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:29.302281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 563/1114] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:29 2022] GET /identity/v3/users/db920ec6e466426aa9aea615fbd6db70 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:29.307906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:29.402092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e0f760-ff4b-4b7d-898f-9a6f185a553c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:29.409825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:29.435561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:29.436232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:29.436507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:29.436772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:29.502358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:29.503918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:29.597205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 552/1115] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:29.602967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:29.698434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda3aa17-4b77-4329-bc21-7d2309970f35 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:29.709270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:29.731738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:29.732370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:29.732664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:29.732915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:29.734013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:29.735428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47db1409-e9e7-4175-a01e-60c623f116c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:29.737048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 564/1116] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:29 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:29.743021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:29.751374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:29.838958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11709944-f80d-49a6-b44f-70237adb52cb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:29.871019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:29.871557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:29.871860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:29.872135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:29.872855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=5311935cd5af4102b5ccb580722cc10a, user.id=db920ec6e466426aa9aea615fbd6db70) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:29.873161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:29.875092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46a31f27-7205-4cae-94b0-a2426bf28bc3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:29.880261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 553/1117] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:29 2022] GET /identity/v3/role_assignments?user.id=db920ec6e466426aa9aea615fbd6db70&scope.project.id=5311935cd5af4102b5ccb580722cc10a&role.id=7da111f273124548ab0a4deafd90a54f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:31.976195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0e62-bdbd-4bb4-abde-c47dd29965d5 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:31.976771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0e62-bdbd-4bb4-abde-c47dd29965d5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:31.976771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1d0e62-bdbd-4bb4-abde-c47dd29965d5 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:31.978061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 565/1118] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:31.983605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:31.984021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:31.984178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:32.002839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:32.004065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:32.062636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:32.067371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 554/1119] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:32.332603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0e62-bdbd-4bb4-abde-c47dd29965d5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:32.430645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1d0e62-bdbd-4bb4-abde-c47dd29965d5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:32.464862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:32.465489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:32.465765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:32.466036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] PATH_INFO: `/v3/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:32.468072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] RBAC: Authorizing `identity:get_role(role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:32.469423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:32.470734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 566/1120] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:32 2022] GET /identity/v3/roles/7da111f273124548ab0a4deafd90a54f => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:32.476477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:32.571070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d25a48-2e6f-46e5-aad6-3091c464b169 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:32.603347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:32.603936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:32.604225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:32.604490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] PATH_INFO: `/v3/users/db920ec6e466426aa9aea615fbd6db70` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:32.605609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] RBAC: Authorizing `identity:get_user(user_id=db920ec6e466426aa9aea615fbd6db70)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:32.607059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:32.608659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 555/1121] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:32 2022] GET /identity/v3/users/db920ec6e466426aa9aea615fbd6db70 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:32.614180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:32.659628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:32.712817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f93c92-b21c-46b8-adbf-2eb1654fb46e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:32.745186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:32.745809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:32.746089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:32.746358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:32.747462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:32.749395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bfb05-d4ac-4c8b-a623-6fb01e82a167 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:32.751002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 567/1122] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:32 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:32.756927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:32.821924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:32.853777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13c852f-b24a-4717-8bf1-3133acbf88c1 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:32.885871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:32.886505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:32.886782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:32.887053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a/users/db920ec6e466426aa9aea615fbd6db70/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:32.889235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] RBAC: Authorizing `identity:create_grant(project_id=5311935cd5af4102b5ccb580722cc10a, user_id=db920ec6e466426aa9aea615fbd6db70, role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:32.890641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c633c21-9b24-4d20-bc81-79c30643af21 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:32.902866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 556/1123] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:40:32 2022] PUT /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a/users/db920ec6e466426aa9aea615fbd6db70/roles/7da111f273124548ab0a4deafd90a54f => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:40:35.018288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3ef1-fff2-41f7-96e6-56c11837e83e None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:35.018825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3ef1-fff2-41f7-96e6-56c11837e83e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:35.018825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63e3ef1-fff2-41f7-96e6-56c11837e83e None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:35.020199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 568/1124] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:35.025739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:35.026166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:35.026279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:35.044476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:35.046247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:35.109820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 557/1125] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:35.382724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3ef1-fff2-41f7-96e6-56c11837e83e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:35.480256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63e3ef1-fff2-41f7-96e6-56c11837e83e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:35.493903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:35.514731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:35.515350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:35.515627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:35.515922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] PATH_INFO: `/v3/roles/7da111f273124548ab0a4deafd90a54f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:35.517297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] RBAC: Authorizing `identity:get_role(role_id=7da111f273124548ab0a4deafd90a54f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:35.518647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:35.519991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 569/1126] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:35 2022] GET /identity/v3/roles/7da111f273124548ab0a4deafd90a54f => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:35.526116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:35.582326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:35.621861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1d2794-bf73-4fe6-a6eb-df9b656df0be None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:35.654524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:35.655069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:35.655342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:35.655610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] PATH_INFO: `/v3/users/db920ec6e466426aa9aea615fbd6db70` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:35.656729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] RBAC: Authorizing `identity:get_user(user_id=db920ec6e466426aa9aea615fbd6db70)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:35.658137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:35.659668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 558/1127] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:35 2022] GET /identity/v3/users/db920ec6e466426aa9aea615fbd6db70 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:35.665235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:35.760539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863d7a8f-92bd-4e31-b30a-1c120aeb143a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:35.793447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:35.794036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:35.794314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:35.794580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:35.841320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:35.859838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:35.861266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:35.959922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 570/1128] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:35 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:35.965905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:36.060447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194af49a-bafa-4a71-80dc-412d009ed067 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:36.084849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:36.093488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:36.094100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:36.094377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:36.094648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] PATH_INFO: `/v3/projects/5311935cd5af4102b5ccb580722cc10a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:36.095759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] RBAC: Authorizing `identity:get_project(project_id=5311935cd5af4102b5ccb580722cc10a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:36.097179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-542769d0-702b-4f12-bd0e-01919050dce1 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:36.098773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 559/1129] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:35 2022] GET /identity/v3/projects/5311935cd5af4102b5ccb580722cc10a => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:36.104865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:36.183405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:36.202264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f391a9-ba9b-4527-9cd0-e08cadebd210 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:36.235051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:36.235651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:36.235957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:36.236228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:36.236941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] RBAC: Adding query filter params (role.id=7da111f273124548ab0a4deafd90a54f, scope.project.id=5311935cd5af4102b5ccb580722cc10a, user.id=db920ec6e466426aa9aea615fbd6db70) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:36.237244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:36.238651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5891bc08-90f5-49f5-8c11-7d5125c26d12 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:36.244491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 571/1130] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:36 2022] GET /identity/v3/role_assignments?user.id=db920ec6e466426aa9aea615fbd6db70&scope.project.id=5311935cd5af4102b5ccb580722cc10a&role.id=7da111f273124548ab0a4deafd90a54f => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:38.398211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd5cde-ed23-47fe-89a4-32aebf3d675b None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:38.398750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd5cde-ed23-47fe-89a4-32aebf3d675b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:38.398750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbd5cde-ed23-47fe-89a4-32aebf3d675b None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:38.400222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 560/1131] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:38.405439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:38.405817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:38.405974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:38.424857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:38.426034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:38.490654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 572/1132] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:38.762526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd5cde-ed23-47fe-89a4-32aebf3d675b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:38.860128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbd5cde-ed23-47fe-89a4-32aebf3d675b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:38.892475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:38.893086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:38.893360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:38.893628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:38.894717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:38.896164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344b9ab8-a3a6-4440-9a3b-7352e30ae9da None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:38.898029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 561/1133] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:38.903851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:38.975228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:38.997621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305da5b0-5bd3-4002-9821-71106fbe4938 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:39.031028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:39.031556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:39.031855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:39.032120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:39.032751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:39.034175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3e2d1c7-a0c9-4a5b-9985-9ce72ff7e6d1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:39.059788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 573/1134] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:40:38 2022] POST /identity/v3/projects => generated 311 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:40:41.232954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242534-a566-4c76-86bd-9494230a0ddf None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:41.233538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242534-a566-4c76-86bd-9494230a0ddf None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:41.233538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32242534-a566-4c76-86bd-9494230a0ddf None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:41.234821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 562/1135] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:41.240406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:41.240835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:41.240953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:41.259325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:41.260526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:41.325311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 574/1136] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:40:41.600779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242534-a566-4c76-86bd-9494230a0ddf None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:41.662210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:41.700485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32242534-a566-4c76-86bd-9494230a0ddf None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:41.733266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:41.733872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:41.734145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:41.734408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] PATH_INFO: `/v3/domains/default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:41.735507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:41.736955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35753ab9-622b-41dc-81bf-d1afd05a3c80 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:41.738489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 563/1137] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:40:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:41.744110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:41.799251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:41.842237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248eeb7e-719c-435f-ab21-e225854ccf17 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:41.874588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:41.875119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:41.875396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:41.875663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:41.876340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:41.877754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5583f947-a2f3-469e-a81b-d654b8fb47dd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:41.898712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 575/1138] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:40:41 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:40:44.049742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd98ad-ad4b-48ca-99db-4b8020297504 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.050306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd98ad-ad4b-48ca-99db-4b8020297504 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.050306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccd98ad-ad4b-48ca-99db-4b8020297504 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:44.051606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 564/1139] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:44.056696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.057139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.057231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:44.077211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:44.078396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:44.142930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 576/1140] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:44.409733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd98ad-ad4b-48ca-99db-4b8020297504 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:44.508240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccd98ad-ad4b-48ca-99db-4b8020297504 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:44.535928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:44.541747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:44.542364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.542640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.542906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:44.553270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:44.558309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:44.559464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:44.560533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 565/1141] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:44.565706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:44.609463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:44.663607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e622b029-ef11-49ad-be45-e72ce4bbd149 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:44.696189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:44.696787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.697064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.697331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:44.697982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:44.698280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:44.699629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:44.708331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 577/1142] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:44.714371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:44.811315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0a5071-f265-455c-aa86-18ff67281303 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:44.843842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:44.844454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.844731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.845000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] PATH_INFO: `/v3/users/83d51a71982041e492d8c9962abbea8e` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:44.857255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] RBAC: Authorizing `identity:get_user(user_id=83d51a71982041e492d8c9962abbea8e)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:44.858682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:44.860282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 566/1143] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:44 2022] GET /identity/v3/users/83d51a71982041e492d8c9962abbea8e => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:44.866000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:44.962127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ef9cde-dce5-4181-8bde-d42ead13c87d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:44.968730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:44.995361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:44.995982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:44.996256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:44.996520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:45.059632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:45.061666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:45.154269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 578/1144] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:44 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:45.160204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:45.207353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:45.255994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a1be2-1d01-4d3e-957f-fc805b303e2c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:45.288315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:45.288923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:45.289200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:45.289470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] PATH_INFO: `/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:45.290570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] RBAC: Authorizing `identity:get_project(project_id=d9a3fdd355de4c98b9de5c0f251bfed1)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:45.292013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0b8489-ba6e-421d-9ff8-17e50bc99999 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:45.293596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 567/1145] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:45 2022] GET /identity/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:45.300129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:45.307955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:45.393348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7858029c-e919-4176-9dc2-462d84badbe1 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:45.426628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:45.427210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:45.427484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:45.427785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:45.428500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=d9a3fdd355de4c98b9de5c0f251bfed1, user.id=83d51a71982041e492d8c9962abbea8e) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:45.428800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:45.430208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2673348e-ba9b-4589-bace-829fe16d0633 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:45.435532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 579/1146] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:45 2022] GET /identity/v3/role_assignments?user.id=83d51a71982041e492d8c9962abbea8e&scope.project.id=d9a3fdd355de4c98b9de5c0f251bfed1&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:47.546228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910553eb-6e89-421f-bad9-300b32218dfc None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:47.546741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910553eb-6e89-421f-bad9-300b32218dfc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:47.546741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910553eb-6e89-421f-bad9-300b32218dfc None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:47.548132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 568/1147] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:47.553280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:47.553694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:47.553828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:47.572063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:47.573245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:47.633353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:47.638910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 580/1148] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:47 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:47.915978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910553eb-6e89-421f-bad9-300b32218dfc None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:48.013782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-910553eb-6e89-421f-bad9-300b32218dfc None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:48.029977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:48.046996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:48.047607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:48.047911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:48.048185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:48.057771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:48.062534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:48.063643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:48.064885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 569/1149] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:48.069424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:48.163635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5bea80-300a-481d-a022-c81fad2d88a2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:48.196534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:48.197061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:48.197334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:48.197600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:48.198240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:48.198535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:48.199911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:48.208100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 581/1150] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:40:48.213720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:48.308343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad807c97-eb56-4b49-8181-fbe9ee5e4758 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:48.340708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:48.341301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:48.341606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:48.341874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] PATH_INFO: `/v3/users/83d51a71982041e492d8c9962abbea8e` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:48.342963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] RBAC: Authorizing `identity:get_user(user_id=83d51a71982041e492d8c9962abbea8e)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:48.344392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:48.345908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 570/1151] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:48 2022] GET /identity/v3/users/83d51a71982041e492d8c9962abbea8e => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:48.351348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:48.410417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:48.448060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7e5a00-72d1-44cd-8578-741786ba03bd None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:48.480061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:48.480674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:48.480948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:48.481213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] PATH_INFO: `/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:48.482326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] RBAC: Authorizing `identity:get_project(project_id=d9a3fdd355de4c98b9de5c0f251bfed1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:48.483747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5359ed6-dfbf-4903-9c64-3d061e04f372 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:48.485364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 582/1152] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:48 2022] GET /identity/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:48.491220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:48.536286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:48.587807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c14facb-d91c-4f9c-b0d8-2ae6ea528834 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:48.620510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:48.621142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:48.621414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:48.621681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] PATH_INFO: `/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1/users/83d51a71982041e492d8c9962abbea8e/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:48.623537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] RBAC: Authorizing `identity:create_grant(project_id=d9a3fdd355de4c98b9de5c0f251bfed1, user_id=83d51a71982041e492d8c9962abbea8e, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:48.624970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acc5d9-d10d-438f-b5e3-b5aeabea9e4b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:48.637874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 571/1153] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:40:48 2022] PUT /identity/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1/users/83d51a71982041e492d8c9962abbea8e/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:40:50.735363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9b1a-95b2-4efa-95b8-0f92ea096689 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:50.735980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9b1a-95b2-4efa-95b8-0f92ea096689 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:50.735980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2c9b1a-95b2-4efa-95b8-0f92ea096689 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:50.737232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 583/1154] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:50.742466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:50.742908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:50.743009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:50.761296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:50.762483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:50.826654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 572/1155] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:51.098974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c9b1a-95b2-4efa-95b8-0f92ea096689 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:51.195497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2c9b1a-95b2-4efa-95b8-0f92ea096689 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:51.223740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:51.229817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:51.230433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:51.230706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:51.230970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:51.240786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:40:51.245509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:51.246805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:40:51.248127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 584/1156] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:51.253164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:51.286020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:51.350850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88057b47-bf18-4301-b1af-f3527c5faea6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:51.383458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:51.384080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:51.384359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:51.384629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:51.385286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:51.385586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:51.386948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:51.395305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 573/1157] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:51.401928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:51.498532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e200458-0e47-4505-ab7f-8bfbd84b894c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:51.531353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:51.531992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:51.532266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:51.532533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] PATH_INFO: `/v3/users/83d51a71982041e492d8c9962abbea8e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:51.533634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] RBAC: Authorizing `identity:get_user(user_id=83d51a71982041e492d8c9962abbea8e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:51.535042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:51.536618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 585/1158] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/users/83d51a71982041e492d8c9962abbea8e => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:51.542352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:51.633684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:51.639926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e310554-b818-4878-a8d3-47091d3b8d31 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:51.672610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:51.673198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:51.673473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:51.673740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:51.737109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:51.738533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:51.825894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:51.833941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 574/1159] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:51.839877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:51.895589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:51.935408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88ad9fc-f8c7-43e6-816a-e3c9e3a4c47e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:51.968251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:51.968851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:51.969123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:51.969390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] PATH_INFO: `/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:51.970483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] RBAC: Authorizing `identity:get_project(project_id=d9a3fdd355de4c98b9de5c0f251bfed1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:51.971912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec62e7d-6b99-4022-94fd-428829fa7923 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:51.973547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 586/1160] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/projects/d9a3fdd355de4c98b9de5c0f251bfed1 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:51.979534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:52.074587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d264a06-14f3-404c-b844-aee4157b96cf None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:52.107263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:52.107877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:52.108155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:52.108448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:52.109165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=d9a3fdd355de4c98b9de5c0f251bfed1, user.id=83d51a71982041e492d8c9962abbea8e) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:52.109469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:52.110868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f8c04a-8d70-4fb1-acc3-5cd56f3b4f18 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:52.116379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 575/1161] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:40:51 2022] GET /identity/v3/role_assignments?user.id=83d51a71982041e492d8c9962abbea8e&scope.project.id=d9a3fdd355de4c98b9de5c0f251bfed1&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:54.418563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd74847-595b-4e40-bf67-9289b7430e40 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:54.419122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd74847-595b-4e40-bf67-9289b7430e40 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:54.419122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd74847-595b-4e40-bf67-9289b7430e40 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:54.420478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 587/1162] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:54.425676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:54.426060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:54.426222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:54.444022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:54.445214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:54.498716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:54.509913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 576/1163] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:54.774614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd74847-595b-4e40-bf67-9289b7430e40 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:54.874907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd74847-595b-4e40-bf67-9289b7430e40 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:54.899629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:54.909234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:54.909826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:54.910101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:54.910368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:54.974371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:54.975817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:55.067862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 588/1164] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:40:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:40:55.073717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:55.167636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-678414b1-22bd-4ceb-acb2-9b25963dd832 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:55.200081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:55.200697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:55.200973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:55.201242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:55.208112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:55.209533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-82143edd-861d-4d29-b19f-155640557f92 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:40:55.221120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:40:55.222352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:40:55.223259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 577/1165] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:40:55 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:40:55.228051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:55.253306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:55.322843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1d0c78-ccbf-423a-9180-d7159d06b73d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:55.355697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:55.356325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:55.356605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:55.356877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:55.357508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:40:55.357809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:55.359228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb0a5f5-b313-428e-8ba1-5dd2f944a6c5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:55.366156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 589/1166] 10.222.0.42 () {56 vars in 1115 bytes} [Tue Sep 20 04:40:55 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:40:57.494136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8122bb3-8353-4c41-9d09-78a084fea073 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:57.494648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8122bb3-8353-4c41-9d09-78a084fea073 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:57.494648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8122bb3-8353-4c41-9d09-78a084fea073 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:57.496048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 578/1167] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:40:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:40:57.501181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d101-7fae-4eed-8f40-cdf718899b78 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:57.501572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d101-7fae-4eed-8f40-cdf718899b78 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:57.501717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd77d101-7fae-4eed-8f40-cdf718899b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:57.519942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-dd77d101-7fae-4eed-8f40-cdf718899b78 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:40:57.521104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dd77d101-7fae-4eed-8f40-cdf718899b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:40:57.584578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 590/1168] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:40:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:40:57.850517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8122bb3-8353-4c41-9d09-78a084fea073 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:40:57.899841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:40:57.948418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8122bb3-8353-4c41-9d09-78a084fea073 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:40:57.981290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:40:57.981874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:40:57.982149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:40:57.982415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:40:57.983068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:40:57.985013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359a6b41-d8e9-45bd-9b1f-0ec897811cea None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:40:57.999947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 579/1169] 10.222.0.42 () {60 vars in 1138 bytes} [Tue Sep 20 04:40:57 2022] POST /identity/v3/domains => generated 267 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:41:00.159108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470fc7-26db-4d8f-8dde-c5742c3a4039 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:00.159774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470fc7-26db-4d8f-8dde-c5742c3a4039 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:00.159774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08470fc7-26db-4d8f-8dde-c5742c3a4039 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:00.161027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 591/1170] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:41:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:41:00.166265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:00.166662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:00.166805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:00.184492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:41:00.185669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:41:00.252606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 580/1171] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:41:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:41:00.522564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08470fc7-26db-4d8f-8dde-c5742c3a4039 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:00.544319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:00.620421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08470fc7-26db-4d8f-8dde-c5742c3a4039 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:00.652983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:00.653597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:00.653875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:00.654145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] PATH_INFO: `/v3/domains/8f2ed7d17b3a424d88ae982bf31f51c4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:00.664651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] RBAC: Authorizing `identity:get_domain(domain_id=8f2ed7d17b3a424d88ae982bf31f51c4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:00.666089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1baa25-65fc-4275-886f-143e69623b0a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:00.667655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 592/1172] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Sep 20 04:41:00 2022] GET /identity/v3/domains/8f2ed7d17b3a424d88ae982bf31f51c4 => generated 267 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:00.673383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:00.713348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:00.770006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-175cd254-93c0-45fe-98e6-b0dfa16824ae None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:00.803005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:00.803596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:00.803904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:00.804175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:00.804827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:00.806234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3941e2d-5a25-4d78-b72a-fa4d41cf9045 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:00.832616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 581/1173] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:41:00 2022] POST /identity/v3/projects => generated 361 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:41:02.975160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8436-4b59-4a52-9852-663c367effb2 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:02.975749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8436-4b59-4a52-9852-663c367effb2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:02.975749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918e8436-4b59-4a52-9852-663c367effb2 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:02.977057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 593/1174] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:41:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:41:02.982571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:02.983047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:02.983699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:03.001338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:41:03.002510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:41:03.066105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 582/1175] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:41:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:41:03.334765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e8436-4b59-4a52-9852-663c367effb2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:03.414748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:03.434772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918e8436-4b59-4a52-9852-663c367effb2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:03.467618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:03.468277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:03.468552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:03.468820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] PATH_INFO: `/v3/domains/8f2ed7d17b3a424d88ae982bf31f51c4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:03.469915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] RBAC: Authorizing `identity:get_domain(domain_id=8f2ed7d17b3a424d88ae982bf31f51c4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:03.471324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94860309-2cf2-46af-be5f-a4eda2130cef None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:03.472891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 594/1176] 10.222.0.42 () {56 vars in 1183 bytes} [Tue Sep 20 04:41:03 2022] GET /identity/v3/domains/8f2ed7d17b3a424d88ae982bf31f51c4 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:03.478548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:03.502171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:03.574133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaac6d-d5fa-4285-870f-fa107b97caa4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:03.606619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:03.607150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:03.607422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:03.607688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:03.608391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:03.609785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1210822-334a-4728-bcda-b07e2bbe6a3e None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:03.630059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 583/1177] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:41:03 2022] POST /identity/v3/users => generated 311 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:41:05.797911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9186ad4-e4cf-46f1-83b2-3a74ac64ca51 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:05.798467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9186ad4-e4cf-46f1-83b2-3a74ac64ca51 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:05.798467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9186ad4-e4cf-46f1-83b2-3a74ac64ca51 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:05.799783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 595/1178] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:41:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:41:05.805138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:05.805572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:05.805678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:05.823338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:41:05.824562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:41:05.888701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 584/1179] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:41:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:41:06.155427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9186ad4-e4cf-46f1-83b2-3a74ac64ca51 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:06.252216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9186ad4-e4cf-46f1-83b2-3a74ac64ca51 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:06.284303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:06.284907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:06.285178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:06.285441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:06.295173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:41:06.300439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:41:06.301591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:41:06.302785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 596/1180] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:41:06 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:41:06.307276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:06.317763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:06.403076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800c1829-c2f0-49e9-9339-ccb1a1b0063e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:06.436667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:06.437209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:06.437484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:06.437752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:06.438436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:41:06.438742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:06.440126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:06.448133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 585/1181] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:41:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:06.454074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:06.465178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:06.555638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb76c921-6cf5-4d52-9861-8e74a17d9247 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:06.588711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:06.589326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:06.589604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:06.589876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] PATH_INFO: `/v3/users/0624255f785c4d52bae83a6dad584a93` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:06.603158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] RBAC: Authorizing `identity:get_user(user_id=0624255f785c4d52bae83a6dad584a93)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:06.604615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:06.606193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 597/1182] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:41:06 2022] GET /identity/v3/users/0624255f785c4d52bae83a6dad584a93 => generated 311 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:06.611978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:06.678523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:06.708866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc87bdfa-73d8-4000-8e7a-799a8456ce2b None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:06.739902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:06.740493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:06.740770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:06.741044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:06.804525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:06.805940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:06.871710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:06.902575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 586/1183] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:41:06 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:41:06.908558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:06.970409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:07.005285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a01ecb3-02bb-4a68-bdda-21a9d9ac6f10 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:07.037994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:07.038604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:07.038879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:07.039147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] PATH_INFO: `/v3/projects/4bc45984053a479bb99ea88f0f1e9389` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:07.040260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc45984053a479bb99ea88f0f1e9389)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:07.041669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e428ef0-9423-4e2b-b3e8-66937e65a587 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:07.043254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 598/1184] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:41:06 2022] GET /identity/v3/projects/4bc45984053a479bb99ea88f0f1e9389 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:07.049912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:07.143618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a180b199-c497-4fea-ad0a-b1708b86ccdd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:07.176256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:07.176837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:07.177109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:07.177376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:07.178093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=4bc45984053a479bb99ea88f0f1e9389, user.id=0624255f785c4d52bae83a6dad584a93) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:41:07.178394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:07.179812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6c77a5-3b56-42db-8501-368d588fcdfb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:07.184904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 587/1185] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:41:07 2022] GET /identity/v3/role_assignments?user.id=0624255f785c4d52bae83a6dad584a93&scope.project.id=4bc45984053a479bb99ea88f0f1e9389&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:09.285981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e6c3-b17f-42df-a8a0-862b2229cdaf None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:09.286570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e6c3-b17f-42df-a8a0-862b2229cdaf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:09.286570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f8e6c3-b17f-42df-a8a0-862b2229cdaf None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:09.287888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 599/1186] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:41:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:41:09.292929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:09.293371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:09.293553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:09.311659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:41:09.312844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:41:09.338049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:09.376423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 588/1187] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:41:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:41:09.645506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e6c3-b17f-42df-a8a0-862b2229cdaf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:09.742924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f8e6c3-b17f-42df-a8a0-862b2229cdaf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:09.776114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:09.776723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:09.777000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:09.777270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:09.779081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:09.787918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:41:09.792676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:41:09.793808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:41:09.794665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 600/1188] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:41:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:41:09.799712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:09.894925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1e5d8e-76df-4592-a7d2-b35e29aeffc3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:09.928307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:09.928834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:09.929109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:09.929375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:09.930016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:41:09.930309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:09.931688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:09.939376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 589/1189] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:41:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:09.944922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:10.040044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c4348-d663-40c5-a7a1-fa3edd48dcf5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:10.073198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:10.073807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:10.074084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:10.074352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] PATH_INFO: `/v3/users/0624255f785c4d52bae83a6dad584a93` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:10.075459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] RBAC: Authorizing `identity:get_user(user_id=0624255f785c4d52bae83a6dad584a93)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:10.077444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:10.078985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 601/1190] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:41:09 2022] GET /identity/v3/users/0624255f785c4d52bae83a6dad584a93 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:10.084713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:10.113037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:10.182544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b3a98-97b2-4948-800a-5679c8ed8341 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:10.214819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:10.215460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:10.215763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:10.216036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] PATH_INFO: `/v3/projects/4bc45984053a479bb99ea88f0f1e9389` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:10.217707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc45984053a479bb99ea88f0f1e9389)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:10.219134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8d22e72-7d20-4eef-9da2-570e16b9e786 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:10.220759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 590/1191] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:41:10 2022] GET /identity/v3/projects/4bc45984053a479bb99ea88f0f1e9389 => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:10.226567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:10.285697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:10.323409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cced2b-1d9a-4f82-86a6-c603d9495eeb None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:10.355364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:10.356035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:10.356315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:10.356587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] PATH_INFO: `/v3/projects/4bc45984053a479bb99ea88f0f1e9389/users/0624255f785c4d52bae83a6dad584a93/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:10.358966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4bc45984053a479bb99ea88f0f1e9389, user_id=0624255f785c4d52bae83a6dad584a93, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:10.360406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470fc01d-cfa5-4aa7-bbed-1a8de25721c6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:10.372256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 602/1192] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:41:10 2022] PUT /identity/v3/projects/4bc45984053a479bb99ea88f0f1e9389/users/0624255f785c4d52bae83a6dad584a93/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:41:12.493716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d7e-b0b4-452b-b0df-9b167ba48fd6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:12.494181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d7e-b0b4-452b-b0df-9b167ba48fd6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:12.494294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99322d7e-b0b4-452b-b0df-9b167ba48fd6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:12.495583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 591/1193] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:41:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:41:12.500952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:12.501335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:12.501493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:12.519621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:41:12.520814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:41:12.584210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 603/1194] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:41:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:41:12.853069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322d7e-b0b4-452b-b0df-9b167ba48fd6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:12.945054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:12.952757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99322d7e-b0b4-452b-b0df-9b167ba48fd6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:12.985165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:12.985780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:12.986058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:12.986330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:12.996408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:41:13.001195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:41:13.002293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:41:13.003299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 592/1195] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:41:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:41:13.008161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:13.058651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:13.105329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3be39-81c9-440a-ad9c-9b910decfb94 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:13.137318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:13.137909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:13.138183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:13.138447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:13.139606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:41:13.139932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:13.141280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:13.149119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 604/1196] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:41:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:13.155651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:13.250341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14c2c1e-af51-4afb-b4b0-58df3b9e8131 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:13.283017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:13.283631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:13.283942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:13.284219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] PATH_INFO: `/v3/users/0624255f785c4d52bae83a6dad584a93` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:13.285337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] RBAC: Authorizing `identity:get_user(user_id=0624255f785c4d52bae83a6dad584a93)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:13.286751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:13.288317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 593/1197] 10.222.0.42 () {56 vars in 1177 bytes} [Tue Sep 20 04:41:13 2022] GET /identity/v3/users/0624255f785c4d52bae83a6dad584a93 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:13.293967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:13.389686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5015ab9-8ec8-4954-a1aa-0cd3eb7678c9 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:13.402818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:13.423260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:13.423899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:13.424181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:13.424453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:13.497568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:13.499030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:13.593316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 605/1198] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:41:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:41:13.599325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:13.623742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:13.696715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b78ee5-99a3-4044-b1b1-51d95a957d65 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:13.729420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:13.730030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:13.730302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:13.730568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] PATH_INFO: `/v3/projects/4bc45984053a479bb99ea88f0f1e9389` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:13.731661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] RBAC: Authorizing `identity:get_project(project_id=4bc45984053a479bb99ea88f0f1e9389)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:13.733735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40845605-bdfb-4d54-8049-cb71f138e087 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:13.735315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 594/1199] 10.222.0.42 () {56 vars in 1186 bytes} [Tue Sep 20 04:41:13 2022] GET /identity/v3/projects/4bc45984053a479bb99ea88f0f1e9389 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:13.741411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:41:13.758165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:13.842720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29255be6-73a4-439a-afb9-7b6ddee37202 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:41:13.874902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:41:13.875491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:41:13.875794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:41:13.876063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:41:13.876772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=4bc45984053a479bb99ea88f0f1e9389, user.id=0624255f785c4d52bae83a6dad584a93) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:41:13.877075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:41:13.878482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5919711-0890-4d17-964d-7f20e356b968 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:41:13.884067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 606/1200] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:41:13 2022] GET /identity/v3/role_assignments?user.id=0624255f785c4d52bae83a6dad584a93&scope.project.id=4bc45984053a479bb99ea88f0f1e9389&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:41:23.725028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=55 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:41:23.881502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=61 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:09.402181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4ca4-86bd-496d-bfe9-8424560eb72e None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:09.403342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4ca4-86bd-496d-bfe9-8424560eb72e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:09.403342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb4ca4-86bd-496d-bfe9-8424560eb72e None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:09.404630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 595/1201] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:09.410428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:09.410872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:09.410957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:09.430416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:09.431648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:09.511311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 607/1202] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:42:09.818064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb4ca4-86bd-496d-bfe9-8424560eb72e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:09.955973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb4ca4-86bd-496d-bfe9-8424560eb72e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:10.000923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:10.001754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:10.002106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:10.002380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:10.015172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:10.017007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:10.035568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:10.037114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:10.038376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:10.038376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:10.038376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:10.038376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 596/1203] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:42:10.044025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:10.162937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2adcb6ee-e9d7-4c86-aa57-e35d159996bd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:10.193772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:10.200932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:10.201769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:10.202049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:10.202322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:10.202969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:10.203273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:10.204667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d2433d-36ad-4a57-a3f7-d0dd0c99fff5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:10.217370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 608/1204] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:10.224436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:10.289634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:10.345555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83dc94c-20ac-4ca2-8bb3-9ad0ca2042e8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:10.388874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:10.389490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:10.389769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:10.390065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:10.390722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:10.392228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8115b1b3-ad44-4365-b23c-518eee1282a6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:10.427872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 597/1205] 10.222.0.42 () {60 vars in 1132 bytes} [Tue Sep 20 04:42:10 2022] POST /identity/v3/users => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:42:12.770187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28023-2d59-41c6-afc7-cb3acf397e19 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:12.770800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28023-2d59-41c6-afc7-cb3acf397e19 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:12.770800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec28023-2d59-41c6-afc7-cb3acf397e19 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:12.772495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 609/1206] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:12.778747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:12.779242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:12.779324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:12.800681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:12.800681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:12.879058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 598/1207] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:13.163206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28023-2d59-41c6-afc7-cb3acf397e19 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:13.278596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec28023-2d59-41c6-afc7-cb3acf397e19 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:13.315574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:13.316261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:13.317457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:13.317457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:13.328870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:13.333666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:13.334683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:13.335600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 610/1208] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:42:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:13.341229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:13.387482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:13.454468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51844fcd-1552-438a-a883-a65d70bb8072 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:13.496590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:13.497672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:13.498050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:13.498307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:13.499096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:13.499405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:13.500967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:13.512491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 599/1209] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:42:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:13.518290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:13.574764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:13.630636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66759f9-f68f-45ee-99aa-4485419089de None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:13.669099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:13.669799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:13.670140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:13.670464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:13.682289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:13.684696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:13.703035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:13.709669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:13.710634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:13.710634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:13.710634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:13.710634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 611/1210] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:13.710885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:13.825197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:13.828776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-298cb2ee-b06e-426d-b5f4-124fd5a51130 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:13.867671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:13.868313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:13.868627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:13.868854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:13.869576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:13.869879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:13.871286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:13.884659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 600/1211] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:13.891076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:14.010392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee552cac-5c07-4352-966e-2c7219a098c0 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:14.012388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:14.050951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:14.051589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:14.051914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:14.052187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:14.060890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:14.062334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:14.075546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:14.076604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:14.077600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 612/1212] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:13 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:14.082551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:14.209249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad83aba2-a38e-47e0-b1f7-f65761e1b553 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:14.250755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:14.255874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:14.277957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 601/1213] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:14 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:14.283343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:14.410497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7860fa-0ca6-460a-a24b-481bc8470142 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:14.455311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:14.455994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:14.456392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:14.456691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:14.494424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:14.543929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:14.544660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:14.655985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 613/1214] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:42:14 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:42:14.658007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:14.679657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:14.778446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3049ad60-e404-4143-9da6-4ec92c3167b2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:14.825738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:14.826444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:14.826760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:14.827122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:14.841000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:14.842620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:14.859185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:14.860436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:14.861353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:14.861353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:14.861353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:14.861353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 602/1215] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:14.867478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:14.934684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:14.982176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2ac25d-0255-4b4b-b689-d2bcaccc3528 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:15.017413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:15.018181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:15.018300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:15.018653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:15.019352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:15.019659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:15.021493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:15.039047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 614/1216] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:15.040293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:15.135247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:15.175062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aafaf37-686d-49e3-8613-827b150ad2b9 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:15.216913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:15.217633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:15.217980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:15.218326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:15.228915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:15.230612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:15.243154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:15.244182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:15.245100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 603/1217] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:15.252269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:15.370066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab31993-ce72-47f7-ba3c-a0d27dbd826a None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:15.399919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:15.413606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:15.414252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:15.414522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:15.414790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:15.415587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:15.415940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:15.417432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18f1438-41c0-4b02-8888-cc9c5d62e30f None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:15.431814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 615/1218] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:15.440665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:15.562159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcce4b86-75d1-4b03-bf4d-01d02062b268 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:15.598865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:15.606536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:15.607259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:15.607586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:15.607834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:15.608566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=b4740fea42bb4ac3878d893eeea5900b) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:15.608877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:15.610420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41f41a0-003e-4f62-ae44-7b1966c26587 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:15.616480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 604/1219] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:42:15 2022] GET /identity/v3/role_assignments?user.id=b4740fea42bb4ac3878d893eeea5900b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 259 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:17.901603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657103-1f06-4199-8fad-ce62f63bc70a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:17.902167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657103-1f06-4199-8fad-ce62f63bc70a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:17.902257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97657103-1f06-4199-8fad-ce62f63bc70a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:17.904096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 616/1220] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:17.909874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:17.910304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:17.910426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:17.930087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:17.931265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:18.012182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 605/1221] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:18.326589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657103-1f06-4199-8fad-ce62f63bc70a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:18.443955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97657103-1f06-4199-8fad-ce62f63bc70a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:18.485629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:18.486493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:18.486906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:18.487292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:18.500163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:18.506021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:18.508337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:18.510347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 617/1222] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:42:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:18.516921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:18.629563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d35672-6a9a-47b7-a882-e6aaab4d7933 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:18.663429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:18.676598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:18.677207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:18.677480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:18.677778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:18.678399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] RBAC: Adding query filter params (name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:18.678694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:18.680086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:18.691132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 606/1223] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:42:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:18.697719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:18.749703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:18.814594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4945808-b600-4f80-b57c-d782c1101392 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:18.851503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da077823-9869-4103-951e-68e695fe7276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:18.852252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da077823-9869-4103-951e-68e695fe7276 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:18.852574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da077823-9869-4103-951e-68e695fe7276 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:18.852852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da077823-9869-4103-951e-68e695fe7276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:18.864323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da077823-9869-4103-951e-68e695fe7276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:18.865883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da077823-9869-4103-951e-68e695fe7276 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-da077823-9869-4103-951e-68e695fe7276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:18.883830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:18.884986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:18.885904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:18.885904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:18.885904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:18.885904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 618/1224] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:18.891464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.008593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f098ae-37cb-4c02-b41e-164fe7045893 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.041914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.043190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.043478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.043822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.044464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:19.044806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.046282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.063512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 607/1225] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:19.064830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da077823-9869-4103-951e-68e695fe7276 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.169401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:19.176464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da077823-9869-4103-951e-68e695fe7276 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.211814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.212452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.212788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.213062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.221294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.223001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:19.234619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:19.235841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:19.236991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 619/1226] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:19.242213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.291413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:19.347130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c895e0f4-8d8b-4403-b9c3-0e864445e7e7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.383137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.383771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.384050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.384319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.385048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:19.385353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.387309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.406555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 608/1227] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:19.412531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.523258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36aed6d2-c743-4062-b47d-0b465c6010b8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.564638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.565272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.565545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.565814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.576915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.578357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:19.592366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:19.593693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:19.594672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:19.594672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:19.594672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:19.594672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 620/1228] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:19.599237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.711152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc238a11-ac6b-4398-9d42-62a0e8e3af66 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.713560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:19.747665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.748294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.748575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.748850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.749491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:19.749814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.751159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.762807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 609/1229] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:19.768579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:19.779021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:19.883091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17183ee6-7999-4d3a-a9c7-f590b4cab30c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:19.920300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:19.920926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:19.921198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:19.921464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:19.927996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:19.929418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:19.940437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:19.941505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:19.942636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 621/1230] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:19.949713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:20.060607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe85b1f-c94f-47ef-beb2-d5371004690c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:20.098299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:20.098915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:20.099211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:20.099484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:20.100234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:20.100520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:20.101969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b61eef-17d9-40b1-8270-827901e22e84 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:20.116651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 610/1231] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:20.123582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:20.193098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:20.231571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39faf1-9b25-4a92-b68d-d9d4bd2cb861 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:20.273532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:20.274341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:20.274732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:20.275011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/b4740fea42bb4ac3878d893eeea5900b/roles/5ef2fd6f566a4d769dc1a6195f2d0148` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:20.292193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=b4740fea42bb4ac3878d893eeea5900b, role_id=5ef2fd6f566a4d769dc1a6195f2d0148)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:20.294925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac3e224-73a2-4227-8c78-25b3658628c4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:20.312222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 622/1232] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:42:20 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/b4740fea42bb4ac3878d893eeea5900b/roles/5ef2fd6f566a4d769dc1a6195f2d0148 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:42:22.663785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581509b6-13a7-44a9-8cbf-c0c6ee8aa7d4 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:22.664368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581509b6-13a7-44a9-8cbf-c0c6ee8aa7d4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:22.664368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581509b6-13a7-44a9-8cbf-c0c6ee8aa7d4 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:22.665652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 611/1233] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:22.671819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:22.672313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:22.672414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:22.692456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:22.693728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:22.769112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 623/1234] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:22 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 20 04:42:23.061582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581509b6-13a7-44a9-8cbf-c0c6ee8aa7d4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:23.090032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:23.184000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581509b6-13a7-44a9-8cbf-c0c6ee8aa7d4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:23.220728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:23.221353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:23.221628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:23.221932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:23.233945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:23.239354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:23.240589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:23.241676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 612/1235] 10.222.0.42 () {56 vars in 1102 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:23.246984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:23.299038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:23.360699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfa191b-f9b4-4d12-b23d-a45ea11a6e42 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:23.398053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:23.398669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:23.398979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:23.399378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:23.400233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] RBAC: Adding query filter params (name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:23.400545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:23.402603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:23.411083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 624/1236] 10.222.0.42 () {56 vars in 1103 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:23.419125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:23.520060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:23.539554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5893d0e8-c6bb-4e89-9c2f-3ac33f0f2f49 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:23.581442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:23.582074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:23.582351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:23.582628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:23.594295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:23.595776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:23.613779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:23.614959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:23.616029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:23.616029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:23.616029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:23.616029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 613/1237] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:42:23.621333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:23.740148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1b6e8e-9c50-4cda-8a47-4e3e9acf2ccf None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:23.749477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:23.779793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:23.780794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:23.781151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:23.781564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:23.782285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:23.782594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:23.784292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:23.797852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 625/1238] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:23.803575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:23.911675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd66d5c8-5293-47da-b4fe-5b99d3d43d46 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:23.944644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:23.945274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:23.945552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:23.945830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:23.949013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:23.954155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:23.955758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:23.967045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:23.973038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:23.974078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 614/1239] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:23.974723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:24.086367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1885aa-cb14-447c-8006-b5229060ab7b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:24.125813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:24.126388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:24.126668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:24.126956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:24.127681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:24.128048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:24.129423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:24.152974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 626/1240] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:23 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:24.159908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:24.264695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66956ac6-1d97-4de4-a937-cae1fde53ba7 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:24.301388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:24.302052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:24.302271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:24.302592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:24.372762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:24.379567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:24.381045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:24.488444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 615/1241] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:42:24 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:42:24.494662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:24.523954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:24.608250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa4790f-216c-4fbc-8199-129c5bd58241 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:24.644439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:24.645352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:24.645634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:24.645998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:24.658804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:24.660425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:24.678241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:24.679431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:24.680655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:24.680655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:24.680655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:24.680655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 627/1242] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:42:24.685094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:24.788878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:24.796542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6ab14b-0203-4aef-b9df-2972f7b014e2 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:24.834192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:24.835242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:24.835242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:24.835582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:24.836105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:24.836407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:24.837791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:24.849541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 616/1243] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:24.855439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:24.941937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:24.966595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00f79647-b967-4795-98b6-cc57f7a1e6b5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:25.003850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:25.004477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:25.004756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:25.005028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:25.012990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:25.014381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:25.026239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:25.027896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:25.028986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 628/1244] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:25.034302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:25.154762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23d73817-5f01-4f91-9672-62d69078bf3c None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:25.194705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:25.195317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:25.195594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:25.195882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:25.196616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:25.196864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:25.198273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d617129-70e7-4932-af5a-23538335ec84 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:25.213872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 617/1245] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:25.220705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:25.332855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc274fe-cafe-4325-acba-d0da44c991ed None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:25.373234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:25.374032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:25.374342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:25.374806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:25.375854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] RBAC: Adding query filter params (role.id=5ef2fd6f566a4d769dc1a6195f2d0148, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=b4740fea42bb4ac3878d893eeea5900b) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:25.376441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:25.378511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8470803e-ec51-4791-a232-e76504e2d7f0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:25.385215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 629/1246] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:42:25 2022] GET /identity/v3/role_assignments?user.id=b4740fea42bb4ac3878d893eeea5900b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=5ef2fd6f566a4d769dc1a6195f2d0148 => generated 608 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:27.747865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48850-c3d1-4a1e-92b7-3749ced58204 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:27.748423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48850-c3d1-4a1e-92b7-3749ced58204 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:27.748505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae48850-c3d1-4a1e-92b7-3749ced58204 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:27.750209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 618/1247] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:27.755477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:27.755975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:27.756090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:27.762372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:27.777096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:27.778400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:27.854455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 630/1248] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:28.163314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae48850-c3d1-4a1e-92b7-3749ced58204 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:28.184456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:28.280271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae48850-c3d1-4a1e-92b7-3749ced58204 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:28.313159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:28.313786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:28.314071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:28.314346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:28.325004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:28.329827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:28.330995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:28.331910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 619/1249] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:42:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:28.337419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:28.451003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac3d633-e90e-400c-92ee-a6623ac0ff90 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:28.483850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:28.489227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:28.489836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:28.490112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:28.490380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:28.491035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:28.491333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:28.492725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:28.501382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 631/1250] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:42:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:28.507553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:28.593506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:28.617882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e21683e-215e-4159-88ef-325c93f96dfd None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:28.654287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:28.655105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:28.655547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:28.655884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:28.666875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:28.668956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:28.686228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:28.687433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:28.694252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:28.694252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:28.694252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:28.694252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 620/1251] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:28.694609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:28.808916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7246e81-e57f-4fce-8790-a4d44bec6571 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:28.847330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:28.847964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:28.848236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:28.848502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:28.849143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:28.849429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:28.850785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:28.869509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 632/1252] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:28.871410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:28.982049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2aa68df-b22e-4453-8775-0d49c9317a63 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:29.010291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:29.019247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:29.019901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:29.020179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:29.020449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:29.028653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:29.030365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:29.043352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:29.044759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:29.045759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 621/1253] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:42:29.052386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:29.122141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:29.174266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154e70a2-6ac4-408d-8dd1-ec115ad74a4e None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:29.210623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:29.211246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:29.211523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:29.211832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:29.212578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:29.212879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:29.214330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:29.233368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 633/1254] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:29 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:29.239104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:29.342543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f8f320-e256-42a5-ac7a-bce28eb513e8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:29.376921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:29.377551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:29.377829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:29.378099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:29.436410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:29.451812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:29.453278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:29.554500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 622/1255] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:42:29 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 20 04:42:29.560333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:29.662139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c493e9a-4867-4a66-a5fc-bae1a9110428 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:29.675385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:29.697099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:29.697731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:29.698008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:29.698805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:29.709101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:29.710530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:29.725165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:29.726268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:29.727458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:29.727458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:29.727458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:29.727458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 634/1256] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:29.732783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:29.818583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:29.830256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46dcbaf4-de8e-4aaf-a36d-d57bc4ad3ec6 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:29.862656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:29.863251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:29.863531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:29.863832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:29.864469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:29.864771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:29.866130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:29.877408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 623/1257] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:29.883048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:29.978801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f902c0d4-3060-48dc-9e31-37e9d0ac92a5 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:30.010914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:30.011518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:30.011822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:30.012094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] PATH_INFO: `/v3/projects/service` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:30.018390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:30.019837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:30.031397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:30.032455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:30.033569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 635/1258] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:30.038299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:30.138271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de49335-b6d6-4a2d-a168-171260361313 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:30.175358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:30.175980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:30.176255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:30.176522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:30.177206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:30.177504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:30.178908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7973ec5-57c0-4e4f-9564-02c818f8d3ce None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:30.190700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 624/1259] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:30.196721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:30.221766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:30.294943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226a532a-b276-4732-aa5d-ac1b4eb1653d None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:30.326840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:30.327424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:30.327698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:30.327995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:30.328706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=b4740fea42bb4ac3878d893eeea5900b) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:30.329007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:30.330413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08c609fe-1af8-403f-adfb-74b861315c1c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:30.335533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 636/1260] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:42:30 2022] GET /identity/v3/role_assignments?user.id=b4740fea42bb4ac3878d893eeea5900b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:32.480716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d93b-377a-4e64-89d8-eac6a81024ee None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:32.481206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d93b-377a-4e64-89d8-eac6a81024ee None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:32.481311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8319d93b-377a-4e64-89d8-eac6a81024ee None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:32.482617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 625/1261] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:32.487797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:32.488201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:32.488349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:32.506539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:32.507716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:32.572300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 637/1262] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:32.839480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319d93b-377a-4e64-89d8-eac6a81024ee None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:32.850203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:32.944082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8319d93b-377a-4e64-89d8-eac6a81024ee None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:32.976335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:32.976954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:32.977229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:32.977498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:32.987687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:32.992471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:32.993505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:32.994360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 626/1263] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:42:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:32.999621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.017160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:33.095085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e92389-3ceb-49de-acf0-931329f52ba6 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.133037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.133990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.134457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.134939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.135711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:33.136227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.137961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.147583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 638/1264] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:42:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:33.154540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.225304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:33.256878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eedf2c4-3bc2-48fa-a497-b27d580a493a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.289037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.289649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.289922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.290188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.300312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.301740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:33.316514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:33.317660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:33.318745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:33.318745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:33.318745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:33.318745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 627/1265] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:33.323962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.402617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:33.420992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988c92b5-e0e6-4d89-ba46-28e586c1b7a4 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.456237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.456841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.457116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.457385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.458016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:33.458313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.459662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.471688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 639/1266] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:33.477183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.571738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f32c5492-1732-444b-a617-c1943972d3cb None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.591053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:33.604532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.605137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.605417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.605688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.612672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.614086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:33.624713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:33.625813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:33.626966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 628/1267] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:33.631470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.727313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f93bad-a2de-4559-adab-926298db090b None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.759744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.760342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.761154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.761421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.762137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:33.762435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.763857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.772408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:33.782933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 640/1268] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:33.790064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:33.886724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336b802f-b139-4f5e-920e-263ceda06009 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:33.919484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:33.920120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:33.920398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:33.920670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:33.930569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:33.932044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:33.945607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:33.946584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:33.947720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:33.947720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:33.947720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:33.947720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 629/1269] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:33.952551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:34.047341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db879f4-763d-46c0-869e-841f7fbe8b3c None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:34.079583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:34.080193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:34.080465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:34.080732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:34.081358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:34.081653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:34.082995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:34.094424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 641/1270] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:34.100556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:34.136302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:34.201428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d220f9f5-8cd7-47f6-aff4-fbf30866e7f3 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:34.233034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:34.233647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:34.233920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:34.234188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:34.240488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:34.241908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:34.253255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:34.254320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:34.255594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 630/1271] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:34.260147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:34.315955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:34.358459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297ddffc-7537-4dc1-9092-a441e81774fc None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:34.390423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:34.391015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:34.391292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:34.391562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:34.392268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:34.392572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:34.393981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5a8bf4-8e50-41f3-b92b-32d2f5f970d9 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:34.406201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 642/1272] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:34.412094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:34.499506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:34.507993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b9775-9d87-426d-87b8-544513a67189 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:34.540246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70410808-2562-46a1-aea6-6da86603399f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:34.540888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410808-2562-46a1-aea6-6da86603399f None admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:34.541166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410808-2562-46a1-aea6-6da86603399f None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:34.541438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70410808-2562-46a1-aea6-6da86603399f None admin] PATH_INFO: `/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/b4740fea42bb4ac3878d893eeea5900b/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:34.543345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70410808-2562-46a1-aea6-6da86603399f None admin] RBAC: Authorizing `identity:create_grant(project_id=c2a7a7ae486945b9badf809df5cfdcf2, user_id=b4740fea42bb4ac3878d893eeea5900b, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:34.544799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70410808-2562-46a1-aea6-6da86603399f None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:34.556489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 631/1273] 10.222.0.42 () {58 vars in 1439 bytes} [Tue Sep 20 04:42:34 2022] PUT /identity/v3/projects/c2a7a7ae486945b9badf809df5cfdcf2/users/b4740fea42bb4ac3878d893eeea5900b/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:42:36.690798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd36b5-5d43-4775-a5b9-8adad3162818 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:36.691357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd36b5-5d43-4775-a5b9-8adad3162818 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:36.691357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fd36b5-5d43-4775-a5b9-8adad3162818 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:36.692702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 643/1274] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:36.698025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:36.698445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:36.698554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:36.716728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:36.717908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:36.781243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 632/1275] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:37.048503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd36b5-5d43-4775-a5b9-8adad3162818 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.158344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fd36b5-5d43-4775-a5b9-8adad3162818 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.181760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:37.198769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.199395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.199672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.199967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.209610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 20 04:42:37.214337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:37.215535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:37.216423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 644/1276] 10.222.0.42 () {56 vars in 1096 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:37.221458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.299436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:37.318165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8c410f-36c0-4b13-83f1-f3c536627c53 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.350031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.350620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.350897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.351167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.351851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] RBAC: Adding query filter params (name=admin) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:37.352153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:37.353513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:37.361655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 633/1277] 10.222.0.42 () {56 vars in 1099 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:37.367458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.464629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba02bfd-1ec2-42fc-8250-8b5ab86ce357 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.497510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.498129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.498403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.498669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.508659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:37.510086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:37.523951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:37.525153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:37.526296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:37.526296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:37.526296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:37.526296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 645/1278] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:37.531325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.628294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2937f960-2679-427f-b430-53ee42a7c029 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.660231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.660819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.661094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.661368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.661999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:37.662297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:37.663646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:37.675357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 634/1279] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:37.680976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.711783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:37.779417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcbde87-2b25-47e9-a9e2-936ecb0a57b8 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.811035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.811646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.811950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.812218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] PATH_INFO: `/v3/users/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.819256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:37.820699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 20 04:42:37.831993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:37.833113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:37.834079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 646/1280] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:37.838722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:37.843042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:37.934577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f226e4a4-b75f-45af-a544-0a15689fd45a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:37.967384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:37.968036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:37.968313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:37.968582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:37.969308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:37.969613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] RBAC: Authorizing `identity:list_users()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:37.971021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:37.987267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 635/1281] 10.222.0.42 () {56 vars in 1143 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:37.993094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:38.079681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:38.089213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e741d2f-bca0-4a1c-be16-14c7d4b4ac00 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:38.123363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:38.123972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:38.124246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:38.124511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:38.189126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:38.190476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:38.272838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:38.283424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 647/1282] 10.222.0.42 () {58 vars in 1282 bytes} [Tue Sep 20 04:42:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 20 04:42:38.289315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:38.347700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:38.384916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4d5a6b-f659-47db-a46e-e9fb139654da None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:38.417707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:38.418419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:38.418693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:38.418960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:38.428442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:38.429867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 20 04:42:38.444502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:38.445619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 20 04:42:38.446920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 20 04:42:38.446920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 20 04:42:38.446920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:38.446920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 636/1283] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:42:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:38.451847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:38.552081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1604c393-bc27-4d1e-9e6a-bdd960ab6b21 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:38.584173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:38.584761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:38.585032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:38.585297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:38.585929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:38.586221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:38.587561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:38.598171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 648/1284] 10.222.0.42 () {56 vars in 1109 bytes} [Tue Sep 20 04:42:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:38.603827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:38.698647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5373a31-f422-4353-a147-0f9018fbb50a None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:38.711851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:38.731817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:38.732422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:38.732695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:38.732964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:38.739206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:38.740641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 20 04:42:38.751313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:38.752379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: ERROR keystone.server.flask.application Sep 20 04:42:38.753490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 637/1285] 10.222.0.42 () {56 vars in 1111 bytes} [Tue Sep 20 04:42:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 20 04:42:38.758073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:38.806439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:38.855092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0cd399-2031-4640-b597-5493a5708637 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:38.887325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:38.887947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:38.888219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:38.888484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:38.889190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:38.889488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:38.890886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e844a28b-3f14-440d-a44a-fe4d9180cc04 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:38.902436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 649/1286] 10.222.0.42 () {56 vars in 1148 bytes} [Tue Sep 20 04:42:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:42:38.908400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:39.002342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f62eab-2ae4-465c-b72d-86ef5035e1f8 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:39.034178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:39.034752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:39.035024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:39.035294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:39.036028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] RBAC: Adding query filter params (role.id=307985de8d134d4587aac9def1fcad5c, scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2, user.id=b4740fea42bb4ac3878d893eeea5900b) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:39.036336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:39.037729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b0ffad-3137-4a15-a9e7-e3728bad33a6 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:39.043159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 638/1287] 10.222.0.42 () {56 vars in 1374 bytes} [Tue Sep 20 04:42:38 2022] GET /identity/v3/role_assignments?user.id=b4740fea42bb4ac3878d893eeea5900b&scope.project.id=c2a7a7ae486945b9badf809df5cfdcf2&role.id=307985de8d134d4587aac9def1fcad5c => generated 608 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:41.200090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea5a1-7043-410d-b085-3fe78fbaad8c None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:41.200627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea5a1-7043-410d-b085-3fe78fbaad8c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:41.200627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7ea5a1-7043-410d-b085-3fe78fbaad8c None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:41.202048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 650/1288] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:41.207242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:41.207687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:41.207807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:41.226009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:41.227191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:41.256070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:41.294295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 639/1289] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:41 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:41.560884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea5a1-7043-410d-b085-3fe78fbaad8c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:41.656886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7ea5a1-7043-410d-b085-3fe78fbaad8c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:41.666941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:41.690783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:41.691388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:41.691661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:41.691954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:41.692525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:41.693868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:41.702422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:41.703643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:41.704573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 651/1290] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:42:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 143 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:41.709424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:41.803600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3611a4cc-4f09-4ede-941e-a3fe14ef002a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:41.835937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:41.836467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:41.836741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:41.837010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:41.837626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] RBAC: Adding query filter params (name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:41.837924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:41.839270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5d6280-7f97-4840-a78e-2d17492809fe None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:41.844384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 640/1291] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 20 04:42:41 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:41.849846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:41.946215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f26234-cbb7-44fa-a7e1-742453190ec3 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:41.978155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:41.978740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:41.979017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:41.979285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] PATH_INFO: `/v3/services` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:41.979934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:41.980233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:41.982136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19578103-dccb-49f4-8393-3bc9611c16b0 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:41.986349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 652/1292] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 20 04:42:41 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:44.104008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964bfbd-43dc-486a-89bb-f7871045c60f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:44.104547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964bfbd-43dc-486a-89bb-f7871045c60f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:44.104547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a964bfbd-43dc-486a-89bb-f7871045c60f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:44.106026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 641/1293] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:42:44.111607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0667a6-44ad-4ed7-aee8-c5bc40e16134 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:44.112029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0667a6-44ad-4ed7-aee8-c5bc40e16134 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:44.112218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0667a6-44ad-4ed7-aee8-c5bc40e16134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:44.131911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7f0667a6-44ad-4ed7-aee8-c5bc40e16134 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:44.133172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7f0667a6-44ad-4ed7-aee8-c5bc40e16134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:44.173581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:44.217316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 653/1294] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:44.486722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964bfbd-43dc-486a-89bb-f7871045c60f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:44.517409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:44.586634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a964bfbd-43dc-486a-89bb-f7871045c60f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:44.618633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:44.619221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:44.619493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:44.619781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:44.620432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:44.622360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a663a19-2165-4988-8a51-0eb665dfdd09 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:44.635828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 642/1295] 10.222.0.42 () {60 vars in 1141 bytes} [Tue Sep 20 04:42:44 2022] POST /identity/v3/services => generated 246 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:42:46.751232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3488-d831-4829-b93b-b0637a8ad489 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:46.751824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3488-d831-4829-b93b-b0637a8ad489 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:46.751824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255b3488-d831-4829-b93b-b0637a8ad489 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:46.753130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 654/1296] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:46.758162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:46.758581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:46.758691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:46.777118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:46.778280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:46.848140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 643/1297] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:46 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:47.112109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3488-d831-4829-b93b-b0637a8ad489 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:47.209987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255b3488-d831-4829-b93b-b0637a8ad489 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:47.242803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:47.243415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:47.243690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:47.243984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:47.244557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:47.246432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:47.254890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:47.256221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:47.257288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 655/1298] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:42:47 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:47.262641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:47.280347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:47.358768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e7ced6-ad41-4551-825b-5d67209643da None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:47.390403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:47.390937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:47.391211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:47.391479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:47.392119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:47.392414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:47.393761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:47.398957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 644/1299] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 20 04:42:47 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:47.405463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:47.436191 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:47.502325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a60a7b-e090-4840-9a38-32add69cd2a6 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:47.535949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:47.536550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:47.536827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:47.537096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:47.537791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] RBAC: Adding query filter params (interface=public, service_id=871a7c4529bf497d8b25ecf9eb95855d, region_id=RegionOne) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:47.538096 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:47.539458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed8caec-138b-4c3e-b345-7a578e9cf6ad None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:47.544394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 656/1300] 10.222.0.42 () {56 vars in 1251 bytes} [Tue Sep 20 04:42:47 2022] GET /identity/v3/endpoints?service_id=871a7c4529bf497d8b25ecf9eb95855d&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:47.550170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:47.627915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:47.646145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849b5cf0-df63-4cf1-b61e-cff0ec3d4b85 None admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:47.678554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:47.679139 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:47.679411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:47.679679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:47.680298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:47.681650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed831c6-5f86-42b5-a54a-550caf38ddcf None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:47.688697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 645/1301] 10.222.0.42 () {56 vars in 1087 bytes} [Tue Sep 20 04:42:47 2022] GET /identity/v3/services => generated 2191 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:42:49.809294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e46f4-32e6-48d7-bab8-e0e1f40dcc81 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:49.809864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e46f4-32e6-48d7-bab8-e0e1f40dcc81 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:49.809864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0e46f4-32e6-48d7-bab8-e0e1f40dcc81 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:49.811171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 657/1302] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:42:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:42:49.816398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:49.816789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:49.816949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:49.835117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:42:49.836332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:42:49.900869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 646/1303] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:42:49 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 20 04:42:50.165941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e46f4-32e6-48d7-bab8-e0e1f40dcc81 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:50.257046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:50.264717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0e46f4-32e6-48d7-bab8-e0e1f40dcc81 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:50.296656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:50.297263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:50.297537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:50.297800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] PATH_INFO: `/v3/services/placement` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:50.298363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:50.299705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 20 04:42:50.308726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 20 04:42:50.309910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.get_or_create( Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application with Lock( Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self._enter() Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application return self.creator() Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application created_value = creator( Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: ERROR keystone.server.flask.application Sep 20 04:42:50.310982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 658/1304] 10.222.0.42 () {56 vars in 1117 bytes} [Tue Sep 20 04:42:50 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 20 04:42:50.315746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:50.387855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:42:50.410192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b2b764-634c-4628-8362-9cc8bff202a5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:50.443304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:50.443304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:50.443584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:50.443884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] PATH_INFO: `/v3/services` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:50.444507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] RBAC: Adding query filter params (name=placement) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:42:50.444802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:50.446146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4485a002-e26c-4925-a2f3-8ac118099921 None admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:50.451201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 647/1305] 10.222.0.42 () {56 vars in 1116 bytes} [Tue Sep 20 04:42:50 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:42:50.456778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:42:50.552248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2213605-8ce1-4e06-8c6f-541acb047387 None admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:42:50.585438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:42:50.586022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:42:50.586295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:42:50.586562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] PATH_INFO: `/v3/endpoints` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:42:50.587219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:42:50.588597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd72ab-04d4-4206-b1b4-88a2f9fe32e6 None admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:42:50.607596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 659/1306] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:42:50 2022] POST /identity/v3/endpoints => generated 331 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:43:00.448216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=30 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:43:00.603824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:43:54.379423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b25e2-dc57-429a-9158-9abaec90320d None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:54.379975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b25e2-dc57-429a-9158-9abaec90320d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:54.380057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563b25e2-dc57-429a-9158-9abaec90320d None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:54.387622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488926e-be93-4b3e-a845-694f50d2103d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:54.388113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488926e-be93-4b3e-a845-694f50d2103d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:54.388204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7488926e-be93-4b3e-a845-694f50d2103d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:54.390852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 648/1307] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:43:54 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:43:54.494322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7488926e-be93-4b3e-a845-694f50d2103d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:43:54.496494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7488926e-be93-4b3e-a845-694f50d2103d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:54.625510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 660/1308] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:43:54.951347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:54.951627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:54.952093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:54.953614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 649/1309] 10.222.0.42 () {54 vars in 963 bytes} [Tue Sep 20 04:43:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:43:54.960906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8663-9b18-4530-a124-df655baa09c4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:54.962038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8663-9b18-4530-a124-df655baa09c4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:54.962477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cc8663-9b18-4530-a124-df655baa09c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:55.048513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-78cc8663-9b18-4530-a124-df655baa09c4 None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:43:55.049706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-78cc8663-9b18-4530-a124-df655baa09c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:55.074042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:43:55.139928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 661/1310] 10.222.0.42 () {58 vars in 1060 bytes} [Tue Sep 20 04:43:54 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:43:55.147123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:43:55.149799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:55.288513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9062ff4e-aef5-48ce-be7f-4d5416f38c06 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:43:55.379976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:43:55.380732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:55.381109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:55.381494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:55.383896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:55.446112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:43:55.521192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:43:55.522796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9599ba56-ca01-4adc-8790-461e9283e2e4 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:43:55.544836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 650/1311] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:43:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:43:58.020133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:58.020662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:58.020662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:58.021997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 662/1312] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:43:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:43:58.027074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a091-3ee8-41a4-93fa-fd40d5ba204a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:58.027473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a091-3ee8-41a4-93fa-fd40d5ba204a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:58.027635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb1a091-3ee8-41a4-93fa-fd40d5ba204a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:58.109391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-edb1a091-3ee8-41a4-93fa-fd40d5ba204a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:43:58.110610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-edb1a091-3ee8-41a4-93fa-fd40d5ba204a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:58.205675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 651/1313] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:43:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:43:58.488217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:43:58.489772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:58.593404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2710f0f5-7110-4d65-bde5-b9b287705602 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:43:58.664734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:43:58.666699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:43:58.667323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:43:58.667604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:43:58.668218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:43:58.670302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:43:58.779560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:43:58.781027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f83fd16-4609-4785-985d-92ae44c72e96 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:43:58.799344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 663/1314] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:43:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:01.281065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-52e3-41fa-a37e-5aea74fef20a None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:01.281578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-52e3-41fa-a37e-5aea74fef20a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:01.281578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d28978-52e3-41fa-a37e-5aea74fef20a None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:01.282877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 652/1315] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:01.288093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cf1e-a042-44ac-aa54-a4d3e101a0be None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:01.288482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cf1e-a042-44ac-aa54-a4d3e101a0be None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:01.288628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62cf1e-a042-44ac-aa54-a4d3e101a0be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:01.353501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8e62cf1e-a042-44ac-aa54-a4d3e101a0be None None] MFA Rules not processed for user `34bfe61c82534b93a479bdd6b667ca12`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:01.354698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8e62cf1e-a042-44ac-aa54-a4d3e101a0be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:01.404843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:01.448695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 664/1316] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:01.749166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:01.749443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:01.749716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:01.751064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 653/1317] 10.222.0.42 () {54 vars in 963 bytes} [Tue Sep 20 04:44:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:01.756788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5e72-5a96-41d9-89af-ca7357606b27 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:01.757072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5e72-5a96-41d9-89af-ca7357606b27 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:01.757342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92b5e72-5a96-41d9-89af-ca7357606b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:01.831754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a92b5e72-5a96-41d9-89af-ca7357606b27 None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:01.833014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a92b5e72-5a96-41d9-89af-ca7357606b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:01.906422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 665/1318] 10.222.0.42 () {58 vars in 1060 bytes} [Tue Sep 20 04:44:01 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:01.915926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:01.917435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:01.926863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:02.017330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae2727-d05e-4508-b6fb-bc417d99f2ba None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:02.087808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:02.088351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:02.088623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:02.088889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:02.090431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:02.151737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:02.196220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:02.197633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf8fe5-8765-4ce2-9e72-4720cb6362ac service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:02.218241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 654/1319] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:01 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:05.289804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:05.290352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:05.290352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:05.291681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 666/1320] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:05.296939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac738-8830-417f-9abb-69cb15067ab8 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:05.297325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac738-8830-417f-9abb-69cb15067ab8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:05.297482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91ac738-8830-417f-9abb-69cb15067ab8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:05.361538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f91ac738-8830-417f-9abb-69cb15067ab8 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:05.362734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f91ac738-8830-417f-9abb-69cb15067ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:05.456793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 655/1321] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:05.742608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:05.744177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:05.794028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:05.847881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885ff44f-3f87-4e93-97e3-69d0313d6cd1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:05.919707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:05.920334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:05.920606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:05.920871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:05.922442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:06.014568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:06.028406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:06.029828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74fec44a-7153-4004-83f2-54300f85aa77 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:06.047306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 667/1322] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:05 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:08.827335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:08.827910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:08.827910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:08.829370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 656/1323] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:08.834347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2130fe-1899-45de-8f0e-272f6091ceba None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:08.834756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2130fe-1899-45de-8f0e-272f6091ceba None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:08.835030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2130fe-1899-45de-8f0e-272f6091ceba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:08.906296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4a2130fe-1899-45de-8f0e-272f6091ceba None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:08.907551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4a2130fe-1899-45de-8f0e-272f6091ceba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:09.009835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 668/1324] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:09.295651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:09.297194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:09.317025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:09.400914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f718f65e-bd58-4318-8969-ab86df55b190 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:09.474676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:09.475268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:09.475544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:09.475851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:09.477964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:09.549770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:09.590920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:09.592399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10f18fa-bfcf-428a-a361-aceffebf0c47 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:09.610858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 657/1325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:11.789010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:11.789585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:11.789585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:11.790944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 669/1326] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:11.796904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbea93-2642-4c2a-a6a3-b08b2a4531eb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:11.797804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbea93-2642-4c2a-a6a3-b08b2a4531eb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:11.798247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0dbea93-2642-4c2a-a6a3-b08b2a4531eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:11.868739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d0dbea93-2642-4c2a-a6a3-b08b2a4531eb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:11.870038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d0dbea93-2642-4c2a-a6a3-b08b2a4531eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:11.966414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 658/1327] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:12.250170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:12.251713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:12.314362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:12.358714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6549f517-5138-4a3d-80fa-eb146eb61c90 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:12.435895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:12.436512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:12.436787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:12.437057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:12.438683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:12.545494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:12.548059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:12.549782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6e0a2c-a034-4017-9f6f-2c9e7b100faf service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:12.568340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 670/1328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:14.784256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:14.784778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:14.784778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:14.786169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 659/1329] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:14.792122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b069-48ae-4392-a9a1-b12f15c3be20 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:14.792532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b069-48ae-4392-a9a1-b12f15c3be20 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:14.792695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d712b069-48ae-4392-a9a1-b12f15c3be20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:14.857932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d712b069-48ae-4392-a9a1-b12f15c3be20 None None] MFA Rules not processed for user `34bfe61c82534b93a479bdd6b667ca12`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:14.859054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d712b069-48ae-4392-a9a1-b12f15c3be20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:14.956767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 671/1330] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:14 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:15.237506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:15.239047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:15.272554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:15.347684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1c91e9-7217-4fa7-8fe1-4f5499d7b636 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:15.423461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:15.424091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:15.424366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:15.424633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:15.426186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:15.503419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:15.535654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:15.537111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa33fd3-965f-4876-803f-339248cf1b17 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:15.554839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 660/1331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:17.936794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:17.937357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:17.937357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:17.938666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 672/1332] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:17.943810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f0c7-6155-410c-b401-60857ec5b17c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:17.944217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f0c7-6155-410c-b401-60857ec5b17c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:17.944382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c448f0c7-6155-410c-b401-60857ec5b17c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:18.009114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c448f0c7-6155-410c-b401-60857ec5b17c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:18.010305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c448f0c7-6155-410c-b401-60857ec5b17c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:18.103231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 661/1333] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:44:18.383097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:18.384673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:18.453956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:18.496657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03fe338-2526-4e2c-8aa0-274a3f55c0ce None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:18.568834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:18.569974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:18.570246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:18.570511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:18.572117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:18.679477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:18.680839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7227c420-a8bc-4819-83ab-d40fcfa61e9a service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:18.690491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:18.700361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 673/1334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:20.889257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:20.889804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:20.889804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:20.891106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 662/1335] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:20.896606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12e8e-3027-4144-9a01-6da9dc8edda5 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:20.897061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12e8e-3027-4144-9a01-6da9dc8edda5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:20.897159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f12e8e-3027-4144-9a01-6da9dc8edda5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:20.964555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f1f12e8e-3027-4144-9a01-6da9dc8edda5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:20.965771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f1f12e8e-3027-4144-9a01-6da9dc8edda5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:21.060164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 674/1336] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:21.343558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:21.345100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:21.384729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:21.446423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1601b31-17f7-43b4-8bfa-718f286fccd2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:21.517730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:21.518326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:21.518597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:21.518863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:21.520703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:21.601305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:21.626749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:21.628208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83c07b08-63ef-4de9-98ea-7ac033b5c3e0 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:21.648069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 663/1337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:24.109571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:24.110228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:24.110228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:24.111463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 675/1338] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:24.117068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901be5-be99-4428-8ea6-b9cc4faa5d68 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:24.117559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901be5-be99-4428-8ea6-b9cc4faa5d68 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:24.117729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59901be5-be99-4428-8ea6-b9cc4faa5d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:24.184909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-59901be5-be99-4428-8ea6-b9cc4faa5d68 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:24.186098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-59901be5-be99-4428-8ea6-b9cc4faa5d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:24.280865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 664/1339] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:24.566862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:24.568475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:24.642224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:24.670963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4679dc4-1045-44f7-a795-7e8780a64382 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:24.743400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:24.744025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:24.744302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:24.744570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:24.746138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:24.851720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:24.853170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51f3fed-9c81-44ff-b1ac-087ac2ce7114 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:24.871033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 676/1340] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:24 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:28.895140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:28.895685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:28.895685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:28.897838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 665/1341] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:28.903390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9df37-c4f8-4b56-916c-4d2833f82e2d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:28.903860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9df37-c4f8-4b56-916c-4d2833f82e2d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:28.903965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f9df37-c4f8-4b56-916c-4d2833f82e2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:28.909803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:28.986133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-98f9df37-c4f8-4b56-916c-4d2833f82e2d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:28.987335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-98f9df37-c4f8-4b56-916c-4d2833f82e2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:29.095287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 677/1342] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:29.381379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:29.382902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:29.432591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:29.488312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e454e-21a3-49b2-9d2f-b7a6280f0e74 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:29.562276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:29.562880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:29.563155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:29.563421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:29.565025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:29.655646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:29.676609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:29.678097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf80f9b-966a-4daf-bebd-5d9f8d5305f6 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:29.696376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 666/1343] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:44:32.496052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:32.496581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:32.496581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:32.497925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 678/1344] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:32.503052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53279-a6ad-48ac-b9b8-fefd1b9fd6ab None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:32.503505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53279-a6ad-48ac-b9b8-fefd1b9fd6ab None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:32.503611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc53279-a6ad-48ac-b9b8-fefd1b9fd6ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:32.570525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0cc53279-a6ad-48ac-b9b8-fefd1b9fd6ab None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:32.571740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0cc53279-a6ad-48ac-b9b8-fefd1b9fd6ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:32.670479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 667/1345] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:32 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:44:32.958440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:32.960575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:33.052600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:33.070964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e91639-fafe-46be-8bb0-ed2391641943 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:33.153026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:33.154062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:33.154561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:33.155050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:33.156991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:33.274028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:33.275465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679614b1-62ce-4837-96cf-13ef2a7e3bc1 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:33.293277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 679/1346] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:32 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:37.418507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:37.419016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:37.419016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:37.420420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 668/1347] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:37.425716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34689f9-9ad0-4e92-a0dc-079883e7dcae None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:37.426145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34689f9-9ad0-4e92-a0dc-079883e7dcae None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:37.426271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34689f9-9ad0-4e92-a0dc-079883e7dcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:37.443070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:37.497897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-c34689f9-9ad0-4e92-a0dc-079883e7dcae None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:37.499102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c34689f9-9ad0-4e92-a0dc-079883e7dcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:37.595903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 680/1348] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:37.878142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:37.879662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:37.936814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:37.981822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb96b06-20f8-48ab-a3ff-8366fda67e21 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:38.053896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:38.054504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:38.054782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:38.055056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:38.056790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:38.159567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:38.163983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:38.165437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8449996-c07c-4482-ac45-8ea2bb961f66 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:38.182879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 669/1349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:43.076092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa60fa-0692-4218-9bce-f54234fd634f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:43.076645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa60fa-0692-4218-9bce-f54234fd634f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:43.076645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffa60fa-0692-4218-9bce-f54234fd634f None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:43.078020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 681/1350] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:44:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:43.083450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3930f6-4d4e-49b3-bda3-23be88bbabd2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:43.084490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3930f6-4d4e-49b3-bda3-23be88bbabd2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:43.084573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e3930f6-4d4e-49b3-bda3-23be88bbabd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:43.173660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0e3930f6-4d4e-49b3-bda3-23be88bbabd2 None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:43.175119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0e3930f6-4d4e-49b3-bda3-23be88bbabd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:43.360069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 670/1351] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:44:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:47.546101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3a7-f34a-4473-bb4e-85e33ce6bd07 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:47.546675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3a7-f34a-4473-bb4e-85e33ce6bd07 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:47.546675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9310e3a7-f34a-4473-bb4e-85e33ce6bd07 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:47.548250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 682/1352] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:44:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:47.553936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62369-9be5-4d15-8637-ccc89e5c6a50 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:47.554377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62369-9be5-4d15-8637-ccc89e5c6a50 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:47.554550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f62369-9be5-4d15-8637-ccc89e5c6a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:47.594294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=59 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:47.619999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:47.639903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e2f62369-9be5-4d15-8637-ccc89e5c6a50 None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:47.641327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e2f62369-9be5-4d15-8637-ccc89e5c6a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:47.753334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 671/1353] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:44:47 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:49.121722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928218-101b-48fe-9c93-55bbac701810 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:49.122263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928218-101b-48fe-9c93-55bbac701810 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:49.122263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2928218-101b-48fe-9c93-55bbac701810 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:49.124139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 683/1354] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:44:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:49.130692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8f5f-6bd3-4d1f-9f99-9528cfa1211c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:49.131254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8f5f-6bd3-4d1f-9f99-9528cfa1211c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:49.131797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047d8f5f-6bd3-4d1f-9f99-9528cfa1211c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:49.211277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-047d8f5f-6bd3-4d1f-9f99-9528cfa1211c None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:49.212511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-047d8f5f-6bd3-4d1f-9f99-9528cfa1211c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:49.251990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:49.321933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 672/1355] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:44:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:44:52.811985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cedc-6f9c-427a-b031-26a61a65df80 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:52.812516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cedc-6f9c-427a-b031-26a61a65df80 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:52.812516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e993cedc-6f9c-427a-b031-26a61a65df80 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:52.813855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 684/1356] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:52.819809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c3e1-fff3-4c11-ba9f-c712095fa186 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:52.820264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c3e1-fff3-4c11-ba9f-c712095fa186 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:52.820654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2128c3e1-fff3-4c11-ba9f-c712095fa186 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:52.890562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2128c3e1-fff3-4c11-ba9f-c712095fa186 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:52.891827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2128c3e1-fff3-4c11-ba9f-c712095fa186 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:52.995768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 673/1357] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:53.312144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:53.312606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:53.313078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:53.314876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 685/1358] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 20 04:44:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:53.324009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249355c-155a-4dcf-8916-2425291007b7 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:53.324554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249355c-155a-4dcf-8916-2425291007b7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:53.324964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c249355c-155a-4dcf-8916-2425291007b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:53.354902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.424730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c249355c-155a-4dcf-8916-2425291007b7 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:53.426056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c249355c-155a-4dcf-8916-2425291007b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:53.563904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 674/1359] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 20 04:44:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:44:53.571538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:53.573160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:53.727077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271ec3c-e25c-4f05-84e5-82cf3524e4bf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:53.806597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:53.850193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:53.850948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:53.851197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:53.851572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:53.853208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:53.959850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:53.961459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35bcdb9-f42e-435a-a3e0-5ed54162403c service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:53.981736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 686/1360] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:56.436646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:56.437225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:56.437225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:56.447098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 675/1361] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:56 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:56.447390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853920f-4d00-4ba9-88ee-2bd92338f9aa None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:56.447390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853920f-4d00-4ba9-88ee-2bd92338f9aa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:56.447390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6853920f-4d00-4ba9-88ee-2bd92338f9aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:56.513114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-6853920f-4d00-4ba9-88ee-2bd92338f9aa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:56.514468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6853920f-4d00-4ba9-88ee-2bd92338f9aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:56.560365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:56.622449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 687/1362] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:44:56.916488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:44:56.918020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:56.991501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:57.105057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51a1ea-a12b-4830-9432-48efbf0740d3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:44:57.232115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:44:57.232718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:57.232987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:57.233246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:57.234814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:44:57.258494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:44:57.327662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:44:57.329290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5953f1b4-9520-496e-b0ef-b77dd283ce54 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:44:57.347157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 676/1363] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:44:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:44:59.852791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6020-d8f6-4585-94dc-e0d1bceb4709 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:59.853375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6020-d8f6-4585-94dc-e0d1bceb4709 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:59.853375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706d6020-d8f6-4585-94dc-e0d1bceb4709 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:59.854670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 688/1364] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:44:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:44:59.860165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113b6b-9ecf-4be0-8662-668ecd2d7f59 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:44:59.860632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113b6b-9ecf-4be0-8662-668ecd2d7f59 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:44:59.860924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02113b6b-9ecf-4be0-8662-668ecd2d7f59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:44:59.928173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-02113b6b-9ecf-4be0-8662-668ecd2d7f59 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:44:59.929370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-02113b6b-9ecf-4be0-8662-668ecd2d7f59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:00.030855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:00.033577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 677/1365] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:44:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:00.327227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:00.327502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:00.327818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:00.329295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 689/1366] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 20 04:45:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:00.335504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5c49-7e40-41e7-94f8-c42d2b36b28f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:00.335984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5c49-7e40-41e7-94f8-c42d2b36b28f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:00.336330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478f5c49-7e40-41e7-94f8-c42d2b36b28f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:00.414085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-478f5c49-7e40-41e7-94f8-c42d2b36b28f None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:00.415378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-478f5c49-7e40-41e7-94f8-c42d2b36b28f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:00.549873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 678/1367] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 20 04:45:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:00.557779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:00.559280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:00.713893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1e6a059-a509-42c8-9a42-0097d5ecbb59 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:00.734789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:00.835302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:00.835956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:00.836235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:00.836506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:00.838092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:00.940835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:00.943076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8bd01bc-d679-45e7-b173-54b3fcefe508 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:00.965585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 690/1368] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:01.057300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61ec9-4336-4e11-b8d9-047ac1787021 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:01.059278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61ec9-4336-4e11-b8d9-047ac1787021 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:01.060015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe61ec9-4336-4e11-b8d9-047ac1787021 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:01.062359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 679/1369] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:01.068018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba7d7-a454-466c-9f7a-d61ab14cb950 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:01.068445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba7d7-a454-466c-9f7a-d61ab14cb950 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:01.068822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdba7d7-a454-466c-9f7a-d61ab14cb950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:01.105344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:01.154062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9fdba7d7-a454-466c-9f7a-d61ab14cb950 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:01.155335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9fdba7d7-a454-466c-9f7a-d61ab14cb950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:01.270702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 691/1370] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:01.611333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:01.611333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:01.611333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:01.611333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 680/1371] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 20 04:45:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:01.617640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc6a0-de1a-4179-bcf3-baeab09da385 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:01.617640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc6a0-de1a-4179-bcf3-baeab09da385 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:01.617640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639fc6a0-de1a-4179-bcf3-baeab09da385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:01.697638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-639fc6a0-de1a-4179-bcf3-baeab09da385 None None] MFA Rules not processed for user `4601933cc2c047a8920d7450c0ee4f56`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:01.699185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-639fc6a0-de1a-4179-bcf3-baeab09da385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:01.754428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:01.789938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 692/1372] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 20 04:45:01 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:01.798292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:01.799972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:01.853879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:01.920715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789882aa-04b5-4c66-892e-0f49d5d8ffc0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:02.012676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:02.013551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:02.013922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:02.014367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:02.016531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:02.135460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:02.152488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:02.154021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2442e77-98cf-4cd4-aa91-42faae12a012 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:02.175247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 681/1373] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:03.222603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f50-8472-4e17-8444-00478baad157 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:03.223143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f50-8472-4e17-8444-00478baad157 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:03.223259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e8f50-8472-4e17-8444-00478baad157 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:03.224540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 693/1374] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:03.229813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de233c6-ca4a-4562-9889-2336229ad86f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:03.230213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de233c6-ca4a-4562-9889-2336229ad86f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:03.230491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de233c6-ca4a-4562-9889-2336229ad86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:03.297876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8de233c6-ca4a-4562-9889-2336229ad86f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:03.299102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8de233c6-ca4a-4562-9889-2336229ad86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:03.395711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 682/1375] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:03.693458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8f50-8472-4e17-8444-00478baad157 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:03.695111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-239e8f50-8472-4e17-8444-00478baad157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:03.861663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e8f50-8472-4e17-8444-00478baad157 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:03.918471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:03.981224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:03.981861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:03.982135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:03.982407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:03.984078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:04.079691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:04.081309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1eb81aa-ca6a-49c5-8b40-3353e460ff3d service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:04.100075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 694/1376] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 407 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:06.331396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:06.331962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:06.331962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:06.333421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 683/1377] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:06.338606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3c7b-97e6-436c-bf78-61e308cd4641 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:06.339057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3c7b-97e6-436c-bf78-61e308cd4641 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:06.339227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ef3c7b-97e6-436c-bf78-61e308cd4641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:06.407143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-82ef3c7b-97e6-436c-bf78-61e308cd4641 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:06.408374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-82ef3c7b-97e6-436c-bf78-61e308cd4641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:06.416242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:06.522107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 695/1378] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:06.826956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:06.828530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:06.893911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:06.983015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d130073-4dcc-43a5-8d16-9915d4c4d1ae None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:07.100109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:07.100634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:07.100912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:07.101184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:07.102750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:07.122631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:07.214809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:07.216428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8616c92-817c-4ec2-83fe-757ce99de451 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:07.236767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 684/1379] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:09.462859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:09.463305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:09.463392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:09.465064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 696/1380] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:09.470456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085866-1036-4fb4-88e5-b982169fdbe1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:09.470852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085866-1036-4fb4-88e5-b982169fdbe1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:09.471030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a085866-1036-4fb4-88e5-b982169fdbe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:09.555915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5a085866-1036-4fb4-88e5-b982169fdbe1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:09.557291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5a085866-1036-4fb4-88e5-b982169fdbe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:09.670646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:09.677400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 685/1381] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:09.973337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:09.974857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:10.115200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:10.126291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffbea5b-bf82-49bb-8784-4e6de927ae01 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:10.246819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:10.247422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:10.247697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:10.247991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:10.249579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:10.342569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:10.344204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aed52fa-b94c-44a3-876d-caecfab1d611 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:10.354497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:10.363939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 697/1382] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:12.614036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:12.614749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:12.614749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:12.616102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 686/1383] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:45:12.621345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6603a2-dea6-4a6a-9596-b15bb3cebe08 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:12.621889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6603a2-dea6-4a6a-9596-b15bb3cebe08 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:12.621987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6603a2-dea6-4a6a-9596-b15bb3cebe08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:12.689143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8a6603a2-dea6-4a6a-9596-b15bb3cebe08 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:12.690279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8a6603a2-dea6-4a6a-9596-b15bb3cebe08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:12.809474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 698/1384] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:13.099433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:13.101099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:13.255527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7467592-8768-46c3-9dc5-6877314ee1ad None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:13.328416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:13.377630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:13.378201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:13.378473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:13.378749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:13.381151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:13.480317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:13.482626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b25a54-2135-4019-b3c6-845a86d642e9 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:13.503234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 687/1385] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:45:15.727231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:15.727931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:15.727931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:15.729189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 699/1386] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:15.735031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feed3-eae1-4ca8-812d-c7c558fea29d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:15.735499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feed3-eae1-4ca8-812d-c7c558fea29d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:15.735809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4feed3-eae1-4ca8-812d-c7c558fea29d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:15.816011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-ce4feed3-eae1-4ca8-812d-c7c558fea29d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:15.817686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ce4feed3-eae1-4ca8-812d-c7c558fea29d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:15.865441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:15.942540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 688/1387] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:16.235484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:16.237114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:16.317731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:16.388091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b851ac5d-24f6-4890-bd85-9096fe1416ef None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:16.518776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:16.519483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:16.520495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:16.521110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:16.523447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:16.574333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:16.630165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:16.631830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d04ea63-51ac-4feb-9292-6d73022a9c97 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:16.650277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 700/1388] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:18.856464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2637a-aaf3-4d9d-8f9f-1c942f17e05f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:18.857079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2637a-aaf3-4d9d-8f9f-1c942f17e05f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:18.857079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f2637a-aaf3-4d9d-8f9f-1c942f17e05f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:18.858579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 689/1389] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:18.860109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8f70-8460-4380-94ce-79a323be2562 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:18.860528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8f70-8460-4380-94ce-79a323be2562 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:18.860654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c8f70-8460-4380-94ce-79a323be2562 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:18.861970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 701/1390] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:18.863142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:18.863969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:18.864242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:18.867412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c0516-b365-47f2-92b9-ae023cc0991e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:18.867695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c0516-b365-47f2-92b9-ae023cc0991e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:18.867999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca2c0516-b365-47f2-92b9-ae023cc0991e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:18.933362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:18.934102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:18.936276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ca2c0516-b365-47f2-92b9-ae023cc0991e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:18.937162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ca2c0516-b365-47f2-92b9-ae023cc0991e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:19.036791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 690/1391] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:19.037543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 702/1392] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:19.325008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:19.326225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:19.340526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:19.343020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3447b-eed2-4390-aff0-041c0eb284c8 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:19.343312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3447b-eed2-4390-aff0-041c0eb284c8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:19.343589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c3447b-eed2-4390-aff0-041c0eb284c8 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:19.345113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 703/1393] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 20 04:45:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:45:19.349853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:19.350168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:19.350444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:19.366566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:19.430275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] MFA Rules not processed for user `c71d74618fe94bddab05e457aaab72ff`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:19.431488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:19.446728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be1daf3-d0dc-4525-8e14-2ee46fa71cd5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:19.510876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 704/1394] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 20 04:45:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:19.520893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:19.528301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9f60c-bf20-4dcc-a9c0-a67c9c6e5546 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:19.563111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:19.563645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:19.563944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:19.564211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:19.565779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:19.574340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:19.607912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:19.608524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:19.608798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:19.609067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:19.610656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:19.644130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:19.659123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:19.660936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6297c77e-b29f-4f96-8b87-bc5542ac1943 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:19.679723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 691/1395] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:19.728061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:19.729485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5115fd-87d6-4c33-97a1-cea142d74589 service glance] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:19.756130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 705/1396] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:45:20.500203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f817e-f042-48d3-8d7a-472498a514e8 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:20.500718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f817e-f042-48d3-8d7a-472498a514e8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:20.500822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2f817e-f042-48d3-8d7a-472498a514e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:20.568747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bd2f817e-f042-48d3-8d7a-472498a514e8 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:20.569885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bd2f817e-f042-48d3-8d7a-472498a514e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:20.655352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:20.658997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 692/1397] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:20.705482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:20.705961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:20.706063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:20.707407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 706/1398] 10.222.0.42 () {54 vars in 943 bytes} [Tue Sep 20 04:45:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:20.714318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbee3-c700-4376-af3f-0ef986a61bcb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:20.714602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbee3-c700-4376-af3f-0ef986a61bcb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:20.714871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbfbee3-c700-4376-af3f-0ef986a61bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:20.789635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fbbfbee3-c700-4376-af3f-0ef986a61bcb None None] MFA Rules not processed for user `be18420a973d4c8ab00a488d465cdd03`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:20.790837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fbbfbee3-c700-4376-af3f-0ef986a61bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:20.901172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 693/1399] 10.222.0.42 () {58 vars in 1040 bytes} [Tue Sep 20 04:45:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:20.910792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:20.912384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:21.065402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:21.068477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a77e6e-eaec-4d16-9625-4ced1f1dc9bb None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:21.187328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:21.187910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:21.188182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:21.188450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:21.190338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:21.272349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:21.273934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ddb1b-6891-4441-93e1-ddc70885c9ed service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:21.281868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 707/1400] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 04:45:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 04:45:21.894318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:21.895487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:21.895487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:21.896790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 694/1401] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:21.902695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc861-8ae2-4c54-8317-464b28d305e3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:21.903197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc861-8ae2-4c54-8317-464b28d305e3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:21.903314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52cc861-8ae2-4c54-8317-464b28d305e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:21.949133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:21.983963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b52cc861-8ae2-4c54-8317-464b28d305e3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:21.985379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b52cc861-8ae2-4c54-8317-464b28d305e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:22.096859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 708/1402] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:22.394031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:22.396380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:22.470836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:22.567704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4910d779-d370-4c73-9aa0-674721a56305 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:22.695941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:22.696971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:22.697481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:22.697837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:22.699534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:22.719467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:22.798714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:22.800461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de64d707-6283-437f-8f62-18a19f76c590 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:22.823988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 695/1403] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:25.066809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:25.066809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:25.066809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:25.068984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 709/1404] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:25.073570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b67-6526-4bed-87fc-c0ae4be07e87 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:25.074035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b67-6526-4bed-87fc-c0ae4be07e87 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:25.074126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86690b67-6526-4bed-87fc-c0ae4be07e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:25.146963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-86690b67-6526-4bed-87fc-c0ae4be07e87 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:25.148373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-86690b67-6526-4bed-87fc-c0ae4be07e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:25.249757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:25.257077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 696/1405] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:25.546458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:25.548009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:25.667547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:25.713183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3f70fa-f115-427a-98d5-4a1257e5828a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:25.833028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:25.833636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:25.833929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:25.834186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:25.835796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:25.918319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:25.943988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:25.945704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e66318bb-6127-4c72-854c-0c7789c53af1 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:25.968395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 710/1406] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 422 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:28.220687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:28.222103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:28.223413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:28.233777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 697/1407] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:45:28 2022] GET /identity => generated 270 bytes in 17 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:28.237680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b224ae-0e49-4bc8-9e73-da80fd517f69 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:28.239918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b224ae-0e49-4bc8-9e73-da80fd517f69 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:28.240438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b224ae-0e49-4bc8-9e73-da80fd517f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:28.315808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-25b224ae-0e49-4bc8-9e73-da80fd517f69 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:28.318026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-25b224ae-0e49-4bc8-9e73-da80fd517f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:28.425723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 711/1408] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:45:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:28.721418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:28.723610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:28.881882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac466a86-6abd-4bd2-9522-1d0a32e3cdbe None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:28.961966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:29.015712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:29.016378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:29.016635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:29.016952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:29.018816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:29.123323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:29.125345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb600b4-080e-420d-ac5d-fc947646a0a9 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:29.145718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 698/1409] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:38.423844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=79 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:39.142295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=64 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:43.634462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a05475-c028-4f84-9167-4ee5b77b6bd7 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:43.635057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a05475-c028-4f84-9167-4ee5b77b6bd7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:43.635057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95a05475-c028-4f84-9167-4ee5b77b6bd7 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:43.636399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 712/1410] 10.222.0.42 () {54 vars in 918 bytes} [Tue Sep 20 04:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:43.641566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4d21-1958-4ef7-bb66-d105e8627ece None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:43.642002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4d21-1958-4ef7-bb66-d105e8627ece None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:43.642108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f4d21-1958-4ef7-bb66-d105e8627ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:43.716145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fa4f4d21-1958-4ef7-bb66-d105e8627ece None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:43.717336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fa4f4d21-1958-4ef7-bb66-d105e8627ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:43.819785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 699/1411] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 20 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:45:43.834336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff990fa-0859-4566-bd7a-24bc7a258d27 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:43.834615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff990fa-0859-4566-bd7a-24bc7a258d27 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:43.834879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff990fa-0859-4566-bd7a-24bc7a258d27 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:43.836231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 713/1412] 10.222.0.42 () {54 vars in 918 bytes} [Tue Sep 20 04:45:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:43.840928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74de0b-3832-460a-bc46-2fa1c57e7b6c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:43.841206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74de0b-3832-460a-bc46-2fa1c57e7b6c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:43.841479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c74de0b-3832-460a-bc46-2fa1c57e7b6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:43.913523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:43.917153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4c74de0b-3832-460a-bc46-2fa1c57e7b6c None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:43.918747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4c74de0b-3832-460a-bc46-2fa1c57e7b6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:44.036217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 700/1413] 10.222.0.42 () {58 vars in 1015 bytes} [Tue Sep 20 04:45:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:46.608958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:46.609517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:46.609517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:46.610843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:45:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:46.616537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140bb1-1e59-4456-b6cc-4eb967f031e3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:46.616977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140bb1-1e59-4456-b6cc-4eb967f031e3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:46.617184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50140bb1-1e59-4456-b6cc-4eb967f031e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:46.682160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-50140bb1-1e59-4456-b6cc-4eb967f031e3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:46.683650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-50140bb1-1e59-4456-b6cc-4eb967f031e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:46.736962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:46.778847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:45:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:47.068447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:47.070116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:47.214557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a6edca-6b78-4f04-a766-57fbcb463fea None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:47.285674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:47.326129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:47.326686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:47.326963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:47.327233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:47.328848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:47.417620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:47.419210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0770a24a-f619-4b41-9e6e-d782ccfbd969 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:47.436911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 715/1416] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:48.573734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:48.574346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:48.574346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:48.576351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:48.583173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dad85-ce8e-4900-9813-577ad5e73b62 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:48.583630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dad85-ce8e-4900-9813-577ad5e73b62 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:48.583775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2dad85-ce8e-4900-9813-577ad5e73b62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:48.658261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9d2dad85-ce8e-4900-9813-577ad5e73b62 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:48.659466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9d2dad85-ce8e-4900-9813-577ad5e73b62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:48.685874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:48.754489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:48.902406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:48.903958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:49.049504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bc2766-eb2f-4faf-8bb0-4bf7aa2e4e11 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:49.089911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:49.165671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:49.166278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:49.166556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:49.166828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:49.168450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:49.258107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:49.259705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92bdd74-9906-4f7e-bb29-9fb6436970d2 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:49.278189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 703/1419] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:50.421517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:50.422103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:50.422103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:50.423448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:50.429832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3c67-fa73-4d9b-943b-ac45248f6257 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:50.430255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3c67-fa73-4d9b-943b-ac45248f6257 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:50.430387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985a3c67-fa73-4d9b-943b-ac45248f6257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:50.484249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:50.508928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-985a3c67-fa73-4d9b-943b-ac45248f6257 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:50.510777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-985a3c67-fa73-4d9b-943b-ac45248f6257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:50.605898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:50.755521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:50.757060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:50.905550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb268a9-1434-40df-8ea2-fe1f1f25e67c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:50.919483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:51.022630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:51.023151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:51.023426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:51.023700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:51.025302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:51.114102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:51.115694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67e211b-0447-459a-be8d-8862f6ea4ee3 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:51.134357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 718/1422] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:52.242688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:52.243274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:52.243274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:52.244599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:52.250998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ee9d-892d-48aa-adeb-0d984c2f432a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:52.251459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ee9d-892d-48aa-adeb-0d984c2f432a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:52.251577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd7ee9d-892d-48aa-adeb-0d984c2f432a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:52.271017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:52.327837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1dd7ee9d-892d-48aa-adeb-0d984c2f432a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:52.329020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1dd7ee9d-892d-48aa-adeb-0d984c2f432a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:52.424324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:52.572967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:52.574421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:52.682300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:52.717093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cabf83-5beb-488f-9bbf-b807e0e9c37f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:52.825814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:52.826352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:52.826625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:52.826926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:52.828572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:52.905094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:52.918856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:52.920495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a090ca21-4d75-4f08-908b-cec31be125cd service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:52.937884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 706/1425] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:54.054631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:54.055298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:54.055298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:54.056620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:54.062654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a22a2-5523-4488-83bc-72b5f9e324aa None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:54.063087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a22a2-5523-4488-83bc-72b5f9e324aa None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:54.063201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73a22a2-5523-4488-83bc-72b5f9e324aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:54.137816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f73a22a2-5523-4488-83bc-72b5f9e324aa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:54.139102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f73a22a2-5523-4488-83bc-72b5f9e324aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:54.233854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:54.382351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:54.383858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:54.466692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:54.529413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f9491be-edc8-4362-ac91-147f38a8afc7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:54.641254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:54.641783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:54.642057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:54.642326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:54.644250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:54.691858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:54.734227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:54.735870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97fcc7c9-8ddc-4538-991b-06788d5c906e service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:54.754533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 721/1428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:55.797358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:55.797943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:55.797943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:55.799241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:55.805430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ca1f-310e-4086-8f05-2d6090ffabfa None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:55.805873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ca1f-310e-4086-8f05-2d6090ffabfa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:55.805988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1079ca1f-310e-4086-8f05-2d6090ffabfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:55.880245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1079ca1f-310e-4086-8f05-2d6090ffabfa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:55.881436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1079ca1f-310e-4086-8f05-2d6090ffabfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:55.982346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:56.135306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:56.136763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:56.185637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:56.279246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483a7650-7b15-466b-8798-f7ea10eadb0a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:56.389085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:56.389602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:56.389873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:56.390137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:56.391707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:56.398704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:56.481043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:56.482623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8f66ae-d0fa-47fd-ac68-86435eab0b7e service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:56.500564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 709/1431] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:57.605117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:57.605690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:57.605690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:57.607002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:57.613858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc47-4640-4181-af3a-53d072d23aea None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:57.614284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc47-4640-4181-af3a-53d072d23aea None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:57.614389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be39fc47-4640-4181-af3a-53d072d23aea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:57.689343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-be39fc47-4640-4181-af3a-53d072d23aea None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:57.691167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-be39fc47-4640-4181-af3a-53d072d23aea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:57.757837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:57.786285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:57.938906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:57.941142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:57.970486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:58.097955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6f6073-2715-4a8f-9e13-b30a3994d745 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:58.184239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:58.209525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:58.210127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:58.210401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:58.210663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:58.212268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:58.299226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:45:58.301373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac54a4e2-ed0b-4967-a8a5-6f651d701c36 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:45:58.318757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 724/1434] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:45:59.357817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:59.358410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:59.358410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:59.359681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:45:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:45:59.365753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac406-e80e-45ce-85a0-756d680a2f72 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:59.366202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac406-e80e-45ce-85a0-756d680a2f72 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:59.366339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189ac406-e80e-45ce-85a0-756d680a2f72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:59.442646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-189ac406-e80e-45ce-85a0-756d680a2f72 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:45:59.443883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-189ac406-e80e-45ce-85a0-756d680a2f72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:59.484188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:59.541374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:45:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:45:59.691174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:45:59.692722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:45:59.834480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95a4c82-b598-4030-8f70-5f07a56adf95 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:45:59.887738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:45:59.945633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116eec04-8354-4227-a701-00045b885846 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:45:59.946166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eec04-8354-4227-a701-00045b885846 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:45:59.946441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eec04-8354-4227-a701-00045b885846 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:45:59.946712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116eec04-8354-4227-a701-00045b885846 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:45:59.948321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-116eec04-8354-4227-a701-00045b885846 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:00.038294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eec04-8354-4227-a701-00045b885846 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:00.039902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116eec04-8354-4227-a701-00045b885846 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:00.057361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 712/1437] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:45:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:01.119928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:01.120518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:01.120518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:01.121822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:46:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:01.128836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410d2a7-dfbf-4cbc-82f1-0132340d1f46 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:01.129328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410d2a7-dfbf-4cbc-82f1-0132340d1f46 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:01.129430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a410d2a7-dfbf-4cbc-82f1-0132340d1f46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:01.206712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a410d2a7-dfbf-4cbc-82f1-0132340d1f46 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:01.207973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a410d2a7-dfbf-4cbc-82f1-0132340d1f46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:01.210009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:01.304188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:46:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:01.451432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:01.452987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:01.602898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b71988-336a-4ddf-bb33-b0828e9195f3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:01.631872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:01.718090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:01.718694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:01.718969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:01.719236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:01.720851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:01.808106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:01.809691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a1f851-d208-465b-a69b-13309637c536 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:01.827057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 727/1440] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:03.904656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:03.905244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:03.905244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:03.906533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:03.911801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c9a3-dcb6-4ed0-8324-0bce7b4fad64 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:03.912222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c9a3-dcb6-4ed0-8324-0bce7b4fad64 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:03.912344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f5c9a3-dcb6-4ed0-8324-0bce7b4fad64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:03.952986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:03.977964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d2f5c9a3-dcb6-4ed0-8324-0bce7b4fad64 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:03.979157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d2f5c9a3-dcb6-4ed0-8324-0bce7b4fad64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:04.075397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:04.360773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:04.362923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:04.464813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec17ef11-7b65-4f0b-be07-bed424627300 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:04.496461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:04.538888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:04.539490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:04.539798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:04.540071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:04.541654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:04.646506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:04.647881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f44ae5-c798-46be-a54a-cb1b69d0f1fa service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:04.666189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 715/1443] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:06.976486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:06.977067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:06.977067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:06.978384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:06.983567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b45c-f5b9-4588-bc1d-a9630cfe905f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:06.984114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b45c-f5b9-4588-bc1d-a9630cfe905f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:06.984231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd5b45c-f5b9-4588-bc1d-a9630cfe905f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:07.049021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9bd5b45c-f5b9-4588-bc1d-a9630cfe905f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:07.050795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9bd5b45c-f5b9-4588-bc1d-a9630cfe905f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:07.063349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:07.146117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:07.427721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:07.429286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:07.531025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a7a658f-6b31-4128-a4ca-bae0953f7114 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:07.544572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:07.604946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:07.605554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:07.605835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:07.606107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:07.607709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:07.715300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:07.716878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10469d2d-c5ae-482c-8275-24de9c55d904 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:07.735102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 730/1446] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:10.185704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:10.186250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:10.186250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:10.187570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:10.192836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1935-3b3c-4c31-8b77-dd986fb4bd15 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:10.193260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1935-3b3c-4c31-8b77-dd986fb4bd15 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:10.193391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2c1935-3b3c-4c31-8b77-dd986fb4bd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:10.241097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:10.258335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-cd2c1935-3b3c-4c31-8b77-dd986fb4bd15 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:10.259510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cd2c1935-3b3c-4c31-8b77-dd986fb4bd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:10.352662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:10.634644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:10.636212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:10.738042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0402638-114b-49fb-bae1-d04ecaf8016f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:10.777118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:10.809810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:10.810409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:10.810680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:10.810946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:10.812531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:10.922283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:10.924019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0b3cbb-f191-4f58-92b1-4a09e17ca68d service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:10.942270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 718/1449] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:13.205269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:13.205896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:13.205896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:13.207199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:13.214614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9aa2-343c-4841-9095-f57882f34934 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:13.215069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9aa2-343c-4841-9095-f57882f34934 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:13.215175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a9aa2-343c-4841-9095-f57882f34934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:13.288118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a59a9aa2-343c-4841-9095-f57882f34934 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:13.289322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a59a9aa2-343c-4841-9095-f57882f34934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:13.309771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:13.385560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:13.675045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:13.676516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:13.777621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059db708-2da4-4363-876c-a9141e93fc0b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:13.797495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:13.850110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:13.850702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:13.850974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:13.851237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:13.853089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:13.959436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:13.960828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acccb3e-9db7-4b12-a4fc-13c83f68ecc0 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:13.978801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 733/1452] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:16.303067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:16.303642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:16.303642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:16.304975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:16.310369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b33d2-327e-4da1-b7a4-f232f052a1a4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:16.310815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b33d2-327e-4da1-b7a4-f232f052a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:16.310923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22b33d2-327e-4da1-b7a4-f232f052a1a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:16.373678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:16.376775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e22b33d2-327e-4da1-b7a4-f232f052a1a4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:16.379131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e22b33d2-327e-4da1-b7a4-f232f052a1a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:16.475401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:16.757633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:16.759165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:16.859295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7583e3-3203-48a7-ac4b-5617b1abe22d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:16.907666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:16.931611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:16.932241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:16.932519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:16.932787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:16.934353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:17.041233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:17.042592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e244e149-3677-4294-8e71-d0bc524baa2f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:17.059924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 721/1455] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:19.366755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:19.367358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:19.367358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:19.368677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:19.374051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b288ab-352c-4bf0-8e45-6ca25f8589e9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:19.374493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b288ab-352c-4bf0-8e45-6ca25f8589e9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:19.374593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b288ab-352c-4bf0-8e45-6ca25f8589e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:19.442088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-16b288ab-352c-4bf0-8e45-6ca25f8589e9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:19.443289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-16b288ab-352c-4bf0-8e45-6ca25f8589e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:19.471128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:19.538673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:46:19.831310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:19.832888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:19.933766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388c9acc-44b7-4118-ad21-68640a8e6d5f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:19.961254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:20.006789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:20.007396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:20.007700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:20.008006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:20.009579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:20.117048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:20.119113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c683a739-b34b-4782-9ff6-08a625f2737b service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:20.138339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 736/1458] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:22.358413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e845-be60-4538-b224-99174507cf28 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:22.359019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e845-be60-4538-b224-99174507cf28 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:22.359019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6174e845-be60-4538-b224-99174507cf28 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:22.360312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:22.366209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d036-42b8-434f-9e87-8755bd3c4aae None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:22.366655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d036-42b8-434f-9e87-8755bd3c4aae None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:22.366781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5706d036-42b8-434f-9e87-8755bd3c4aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:22.431908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5706d036-42b8-434f-9e87-8755bd3c4aae None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:22.433397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5706d036-42b8-434f-9e87-8755bd3c4aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:22.441812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:22.528960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:22.813968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174e845-be60-4538-b224-99174507cf28 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:22.815490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6174e845-be60-4538-b224-99174507cf28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:22.915549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6174e845-be60-4538-b224-99174507cf28 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:22.970315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:22.988162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:22.988758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:22.989049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:22.989297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:22.990865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:23.096969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:23.098358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7578149e-f557-448a-b9e2-2adf98c4e429 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:23.232028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 724/1461] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:25.433701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:25.434361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:25.434361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:25.435582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:25.440911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727b0f-5650-4ac1-82ac-9069593c229f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:25.441961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727b0f-5650-4ac1-82ac-9069593c229f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:25.442065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb727b0f-5650-4ac1-82ac-9069593c229f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:25.506302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cb727b0f-5650-4ac1-82ac-9069593c229f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:25.507518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cb727b0f-5650-4ac1-82ac-9069593c229f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:25.545442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:25.601850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:25.882462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:25.884052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:25.994519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-515b8860-c2aa-4b9b-9a34-b9ddbf4099ab None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:26.032629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:26.068571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:26.069177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:26.069456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:26.069724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:26.071307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:26.189054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:26.190401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8533d-fd4b-44b3-b5ed-7320252c0631 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:26.208669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 739/1464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:28.370028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:28.370614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:28.370614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:28.371930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:28.377295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ee1f-7e1f-4f8f-9adb-c96c4dd192b3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:28.377727 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ee1f-7e1f-4f8f-9adb-c96c4dd192b3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:28.377830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5135ee1f-7e1f-4f8f-9adb-c96c4dd192b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:28.561032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5135ee1f-7e1f-4f8f-9adb-c96c4dd192b3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:28.562243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5135ee1f-7e1f-4f8f-9adb-c96c4dd192b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:28.580329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:28.657502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:28.945078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:28.946636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:29.047901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6bd213-7e34-4c52-921b-47d645eb82df None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:29.112451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:29.119968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:29.120580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:29.120857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:29.121156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:29.122770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:29.229999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:29.231405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755d0ffa-d761-4405-9922-d4ad9c8c14fc service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:29.249174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 727/1467] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:31.452583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:31.453026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:31.453134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:31.454443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:46:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:31.459697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc955-55a6-44a8-91c9-91ed56b81303 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:31.460138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc955-55a6-44a8-91c9-91ed56b81303 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:31.460247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7dc955-55a6-44a8-91c9-91ed56b81303 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:31.527439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7b7dc955-55a6-44a8-91c9-91ed56b81303 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:31.528685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7b7dc955-55a6-44a8-91c9-91ed56b81303 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:31.576477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:31.623921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:46:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:31.907145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:31.908783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:32.012154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7faf960-96e4-4729-9bf3-3065d038de2f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:32.059600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:32.085679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:32.086276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:32.086548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:32.086809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:32.088416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:32.197558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:32.198927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699cb873-218d-4144-89cf-16e59f8bd294 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:32.217084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 742/1470] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:41.622401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=22 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:42.214860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=66 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:52.081535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f62d-c73f-47b9-b756-e0a96424eca3 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:52.082083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f62d-c73f-47b9-b756-e0a96424eca3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:52.082083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e7f62d-c73f-47b9-b756-e0a96424eca3 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:52.083427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 729/1471] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:52.088797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edca1-afcf-48d1-9e4c-07b6d27dbb6c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:52.089238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edca1-afcf-48d1-9e4c-07b6d27dbb6c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:52.089354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71edca1-afcf-48d1-9e4c-07b6d27dbb6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:52.153076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a71edca1-afcf-48d1-9e4c-07b6d27dbb6c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:52.154280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a71edca1-afcf-48d1-9e4c-07b6d27dbb6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:52.247585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 743/1472] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:52.542554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:52.542837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:52.543104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:52.544452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 730/1473] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 20 04:46:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:52.550183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e729-1b6c-4f13-a3a2-e6db65a3a042 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:52.550468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e729-1b6c-4f13-a3a2-e6db65a3a042 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:52.550739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1e729-1b6c-4f13-a3a2-e6db65a3a042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:52.625414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f3d1e729-1b6c-4f13-a3a2-e6db65a3a042 None None] MFA Rules not processed for user `c71d74618fe94bddab05e457aaab72ff`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:52.626613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f3d1e729-1b6c-4f13-a3a2-e6db65a3a042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:52.647791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:52.702136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 744/1474] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 20 04:46:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:52.709873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:52.711393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:52.813478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f45b59-658d-4c8a-bc81-8d956cc6b4f9 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:52.887773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:52.888374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:52.888652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:52.888921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:52.890495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:52.944117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:52.999366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:53.000817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7219873b-8359-489d-80e1-b5696fa86b4f service glance] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:53.018817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 731/1475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:46:55.261785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:55.262364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:55.262364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:55.263683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 745/1476] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:46:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:55.269749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb023-8eae-469c-b057-c91ab765b18d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:55.270382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb023-8eae-469c-b057-c91ab765b18d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:55.270382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3cb023-8eae-469c-b057-c91ab765b18d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:55.338199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6f3cb023-8eae-469c-b057-c91ab765b18d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:55.339412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6f3cb023-8eae-469c-b057-c91ab765b18d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:55.433839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 732/1477] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:46:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:55.706575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:55.708183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:55.831604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12a035e-4310-4751-ab4e-33834c6530a3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:55.879543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:55.925201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:55.926166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:55.926457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:55.926731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:55.927418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:55.929609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:46:55.929609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:46:55.929609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:46:55.931064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2005447-2d75-4006-857c-ee7799c6224b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:55.952369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 746/1478] 10.222.0.42 () {56 vars in 1108 bytes} [Tue Sep 20 04:46:55 2022] GET /identity/v3/projects => generated 2553 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:46:58.122289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:58.122893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:58.122893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:58.124205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 733/1479] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:46:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:46:58.130075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890833-c9a5-40c2-9dee-1a6c64dc041e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:58.130523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890833-c9a5-40c2-9dee-1a6c64dc041e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:58.130640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c890833-c9a5-40c2-9dee-1a6c64dc041e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:58.196314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8c890833-c9a5-40c2-9dee-1a6c64dc041e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:46:58.197545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8c890833-c9a5-40c2-9dee-1a6c64dc041e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:58.296531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 747/1480] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:46:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:46:58.592717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:46:58.594385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:58.604348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:58.737705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d1bb27-0721-46a6-870b-fd24066be91f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:46:58.815507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:46:58.847647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:46:58.848273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:46:58.848547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:46:58.848814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:46:58.850378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:46:58.938025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:46:58.940543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc8c25a-ab25-4aa5-8eb9-4f5607ae7597 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:46:58.959184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 734/1481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:46:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:47:01.289294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:01.289871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:01.289871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:01.291187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 748/1482] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:47:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:47:01.296442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b40ba-468c-4c66-9cac-838a7e25cd3f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:01.296860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b40ba-468c-4c66-9cac-838a7e25cd3f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:01.296978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96b40ba-468c-4c66-9cac-838a7e25cd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:01.361119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d96b40ba-468c-4c66-9cac-838a7e25cd3f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:47:01.362313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d96b40ba-468c-4c66-9cac-838a7e25cd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:01.406940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:01.458692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 735/1483] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:47:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:47:01.762553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:47:01.764119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:01.788272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:01.866018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c755ff-af4a-4dbf-ace3-6f3356058577 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:47:01.936137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:47:01.936730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:01.937018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:01.937264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:01.938861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:02.012360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:02.047210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:47:02.048661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312244b6-e216-4f60-84a6-0611601b50f5 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:47:02.066552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 749/1484] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:47:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:47:04.257332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:04.257921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:04.257921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:04.259207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 736/1485] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:47:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:47:04.264525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7c4d-dab6-4429-9a40-201ab6759dc0 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:04.264921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7c4d-dab6-4429-9a40-201ab6759dc0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:04.265071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13a7c4d-dab6-4429-9a40-201ab6759dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:04.331702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d13a7c4d-dab6-4429-9a40-201ab6759dc0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:47:04.332933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d13a7c4d-dab6-4429-9a40-201ab6759dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:04.427281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 750/1486] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:47:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:47:04.719438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:47:04.721667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:04.827408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436c6177-a334-49b5-8fa2-1b60ec077522 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:47:04.898796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:04.900538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:47:04.901434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:04.901890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:04.902198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:04.904245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:05.011313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:47:05.012688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e8953c-93c0-4c13-bbab-7ea377b16e76 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:47:05.031604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 737/1487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:47:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:47:07.344685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:07.345366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:07.345366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:07.346572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 751/1488] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:47:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:47:07.355648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f442-41c2-4291-ad6e-b3d1763767a1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:07.356181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f442-41c2-4291-ad6e-b3d1763767a1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:07.356287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2f442-41c2-4291-ad6e-b3d1763767a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:07.420318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0cc2f442-41c2-4291-ad6e-b3d1763767a1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:47:07.421526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0cc2f442-41c2-4291-ad6e-b3d1763767a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:07.475216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:07.517228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 738/1489] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:47:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:47:07.809595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:47:07.811128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:07.846540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:07.912534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1876f0-1f98-4669-9f6b-67d5a4c50c09 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:47:07.985627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:47:07.986227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:07.986512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:07.987549 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:07.989160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:08.069404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:08.098418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:47:08.099897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d51ad0-9b6d-4923-ad1d-5ca5ffec4d73 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:47:08.117917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 752/1490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:47:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:47:10.479640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:10.480221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:10.480221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:10.481533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 739/1491] 10.222.0.42 () {54 vars in 927 bytes} [Tue Sep 20 04:47:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:47:10.487327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ec44-ac81-4d7e-a553-dbc62ce1720c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:10.487719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ec44-ac81-4d7e-a553-dbc62ce1720c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:10.487903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f6ec44-ac81-4d7e-a553-dbc62ce1720c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:10.560738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-93f6ec44-ac81-4d7e-a553-dbc62ce1720c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:47:10.561953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-93f6ec44-ac81-4d7e-a553-dbc62ce1720c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:10.656673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 753/1492] 10.222.0.42 () {58 vars in 1024 bytes} [Tue Sep 20 04:47:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:47:10.943868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:47:10.945436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:11.046297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c4aa6e-8b5f-4c05-aa68-41818e0bed6c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:47:11.118623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:47:11.119218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:47:11.119494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:47:11.119796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:47:11.121362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:47:11.130302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:11.231515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:47:11.232971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9accce-8ad2-405a-94fc-db3216f14e38 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:47:11.250800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 740/1493] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:47:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:47:20.655119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=82 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:47:21.248579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=50 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:24.974014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:24.974633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:24.974633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.050416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:48:25.051537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.146954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 754/1494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:48:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:48:25.154969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:25.155453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:25.155552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.229686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:48:25.230885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.323072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 741/1495] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:48:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:48:25.327592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:25.329405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.340848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce622d94-265e-4a7d-bf46-ebc77f1f6fb7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:25.401179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:25.435442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:25.436086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:25.436359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:25.436629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.437884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:48:25.438178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:25.439182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:25.439182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:48:25.439182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:48:25.440086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:25.451212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 755/1496] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:48:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:48:25.459468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:25.468356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795507de-b4b8-4d34-92b0-a6c51bf58d46 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:25.528323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:25.561392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:25.562010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:25.562285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:25.562551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.563182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:25.565500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:25.565500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:48:25.565500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:48:25.566682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:25.620983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 742/1497] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:48:25 2022] POST /identity/v3/projects => generated 379 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:48:25.625084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:25.626576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.659648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c20a1a-00c9-45ef-86be-3f67e19c3bf4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:25.751255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:25.751891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:25.752176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:25.752446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.753080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:25.754079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:25.754079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:48:25.754079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:48:25.755279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:25.796870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 756/1498] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:48:25 2022] POST /identity/v3/users => generated 290 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:48:25.801152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:25.802656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.862616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7746cf2-457f-42bf-a9c8-195269853207 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:25.948959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:25.960492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:25.961084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:25.961362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:25.961625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:25.962262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:25.963269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:25.963269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:48:25.963269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:48:25.964183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:25.976714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 743/1499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:48:25.980847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:25.982499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:25.994157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fb70ae5-f547-40de-ac12-4b53c676b108 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:26.019934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:26.089961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:26.090560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.090833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.091099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.091745 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:26.092750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:26.092750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:48:26.092750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:48:26.093662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bbce87b-3b43-4eed-8dd8-55cefe2b8572 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:26.105665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 757/1500] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:48:25 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:48:26.110441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:26.111989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:26.145336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f82ef0-f85e-4601-94ed-2d92dfefa971 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:26.237900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:26.238575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.238818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.239092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] PATH_INFO: `/v3/projects/61cecbba6feb40eca0edeb3af1d729d6/users/a7233e5e3b5d481aae84de47edc54316/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.261672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61cecbba6feb40eca0edeb3af1d729d6, user_id=a7233e5e3b5d481aae84de47edc54316, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:26.262696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:26.262696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:48:26.262696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:48:26.264637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd82095-5e1f-4f88-a107-3607ccbebe39 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:26.288261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 744/1501] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:48:26 2022] PUT /identity/v3/projects/61cecbba6feb40eca0edeb3af1d729d6/users/a7233e5e3b5d481aae84de47edc54316/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:48:26.301116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b86ce-ec2a-4313-b28b-4b55b2e3cfb2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.301398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b86ce-ec2a-4313-b28b-4b55b2e3cfb2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.301671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d4b86ce-ec2a-4313-b28b-4b55b2e3cfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.360648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-6d4b86ce-ec2a-4313-b28b-4b55b2e3cfb2 None None] MFA Rules not processed for user `a7233e5e3b5d481aae84de47edc54316`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:48:26.361861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6d4b86ce-ec2a-4313-b28b-4b55b2e3cfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:26.438363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 758/1502] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:48:26.451193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.451477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.451775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.453674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 745/1503] 10.222.0.42 () {54 vars in 962 bytes} [Tue Sep 20 04:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:48:26.458544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d370-4045-46b5-84dc-4ed7f1369725 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.458839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d370-4045-46b5-84dc-4ed7f1369725 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.459112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf3d370-4045-46b5-84dc-4ed7f1369725 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.490245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:26.536710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ebf3d370-4045-46b5-84dc-4ed7f1369725 None None] MFA Rules not processed for user `4601933cc2c047a8920d7450c0ee4f56`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:48:26.537913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ebf3d370-4045-46b5-84dc-4ed7f1369725 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:26.611790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 759/1504] 10.222.0.42 () {58 vars in 1059 bytes} [Tue Sep 20 04:48:26 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:48:26.619567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:26.621095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:26.677750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:26.731502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc07844-d464-4e85-81d0-41e59830a0d5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:26.805434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:26.805933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.806209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.806473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.808075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:26.903624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:26.905040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:26.908955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:26.923792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 746/1505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:48:26 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:48:26.968865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06acba-6e78-4857-bbcf-24e866169651 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:26.969153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06acba-6e78-4857-bbcf-24e866169651 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:26.969423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e06acba-6e78-4857-bbcf-24e866169651 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:26.970676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 760/1506] 10.222.0.42 () {52 vars in 830 bytes} [Tue Sep 20 04:48:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:48:26.974196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:26.975386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:27.072561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3bd248-4b08-4bed-bdae-056fba853cc5 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:27.162911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:27.163532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:27.163839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:27.164107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] PATH_INFO: `/v3/users/a7233e5e3b5d481aae84de47edc54316` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:27.177313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a7233e5e3b5d481aae84de47edc54316)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:27.178320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:27.178320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:48:27.178320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:48:27.179516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:27.189652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:27.244531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a7233e5e3b5d481aae84de47edc54316'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:27.245173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a7233e5e3b5d481aae84de47edc54316'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:27.245463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a7233e5e3b5d481aae84de47edc54316'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:27.267574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a7233e5e3b5d481aae84de47edc54316'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:27.282310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a7233e5e3b5d481aae84de47edc54316'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:27.296032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 747/1507] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:48:26 2022] DELETE /identity/v3/users/a7233e5e3b5d481aae84de47edc54316 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:48:27.300928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:27.301406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:27.301514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:27.356918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:48:27.358033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:27.440158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:27.447525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 761/1508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:48:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:48:27.457677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:27.458892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:27.557844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d55bddb5-16e7-4a27-9140-98ff0d4c6c07 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:27.612050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:27.633223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:27.633830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:27.634107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:27.634411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:27.636007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:27.744366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:27.745786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0a8f0b-f15a-45f2-b56e-f34fb8789ae8 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:27.765762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 748/1509] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:48:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:48:28.116479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:48:28.117714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:48:28.129286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a69fd3-3032-4891-a1a5-4c0ccc643174 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:48:28.231202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:48:28.231862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:48:28.232139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:48:28.232406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] PATH_INFO: `/v3/projects/61cecbba6feb40eca0edeb3af1d729d6` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:48:28.242627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61cecbba6feb40eca0edeb3af1d729d6)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:48:28.243644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:48:28.243644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:48:28.243644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:48:28.244870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:48:28.303276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61cecbba6feb40eca0edeb3af1d729d6', 'request_id': 'req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:28.313051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61cecbba6feb40eca0edeb3af1d729d6', 'request_id': 'req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:28.327273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61cecbba6feb40eca0edeb3af1d729d6', 'request_id': 'req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:28.349766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] The token cache is being invalidate because project 61cecbba6feb40eca0edeb3af1d729d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:48:28.350055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:28.350569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-daaf33a8-e5d0-4f68-9e7f-d35cd0288834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:48:28.351888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 762/1510] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:48:28 2022] DELETE /identity/v3/projects/61cecbba6feb40eca0edeb3af1d729d6 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:48:37.762901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=62 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:48:38.347784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:00.392084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:00.392972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:00.392972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:00.394330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:50:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:00.399319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d200-e5b8-4b99-8416-16e2d2b81c1a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:00.399956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d200-e5b8-4b99-8416-16e2d2b81c1a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:00.399956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a78d200-e5b8-4b99-8416-16e2d2b81c1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:00.482675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4a78d200-e5b8-4b99-8416-16e2d2b81c1a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:00.483913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4a78d200-e5b8-4b99-8416-16e2d2b81c1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:00.588835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:50:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:00.747854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:00.748764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:00.869916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73ad3b8-248f-46f9-ae8e-7e994875f2df None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:00.876001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:00.876609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:00.876887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:00.877160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:00.885328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:00.886897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb9a8de-d26c-4bdc-8834-fee9982103e2 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:00.896657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 750/1513] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:01.981874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5ce0-7a7d-4f4d-9a62-cb36c07a55cd None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:01.982440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5ce0-7a7d-4f4d-9a62-cb36c07a55cd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:01.982440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757f5ce0-7a7d-4f4d-9a62-cb36c07a55cd None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:01.983813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:50:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:01.990121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670b12-dad7-4421-91a7-4a2ce178eefa None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:01.990566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670b12-dad7-4421-91a7-4a2ce178eefa None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:01.990668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2670b12-dad7-4421-91a7-4a2ce178eefa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:02.009931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e2670b12-dad7-4421-91a7-4a2ce178eefa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:02.011140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e2670b12-dad7-4421-91a7-4a2ce178eefa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:02.019573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:50:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:02.170801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5ce0-7a7d-4f4d-9a62-cb36c07a55cd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:02.184869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757f5ce0-7a7d-4f4d-9a62-cb36c07a55cd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:02.190278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:02.190871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:02.191151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:02.191425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:02.199910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:02.201553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff001a8-6e5f-499a-bbdd-ff53df0f9e97 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:02.210967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 765/1516] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:02.682854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134b71-726b-4a63-b849-0e29d2397363 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:02.683135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134b71-726b-4a63-b849-0e29d2397363 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:02.683947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66134b71-726b-4a63-b849-0e29d2397363 None None] PATH_INFO: `/v3` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:02.685221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 752/1517] 10.222.0.26 () {54 vars in 925 bytes} [Tue Sep 20 04:50:02 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:50:02.691457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e72dd-cff4-4660-9e1a-9e632e68bd73 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:02.691750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e72dd-cff4-4660-9e1a-9e632e68bd73 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:02.692057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-920e72dd-cff4-4660-9e1a-9e632e68bd73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:02.750379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-920e72dd-cff4-4660-9e1a-9e632e68bd73 None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:02.751567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-920e72dd-cff4-4660-9e1a-9e632e68bd73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:02.768449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:02.823107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 766/1518] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 20 04:50:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:11.731150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f33-91ed-4506-96dc-71b04b83f5da None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:11.731643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f33-91ed-4506-96dc-71b04b83f5da None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:11.731867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb9f33-91ed-4506-96dc-71b04b83f5da None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:11.733067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 753/1519] 10.222.0.42 () {54 vars in 961 bytes} [Tue Sep 20 04:50:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:11.738140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33a1c-f263-4b50-9631-a94aa49ffd4d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:11.738584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33a1c-f263-4b50-9631-a94aa49ffd4d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:11.738683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd33a1c-f263-4b50-9631-a94aa49ffd4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:11.757762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-acd33a1c-f263-4b50-9631-a94aa49ffd4d None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:11.758955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-acd33a1c-f263-4b50-9631-a94aa49ffd4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:11.768368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 767/1520] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Sep 20 04:50:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:11.775638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9f33-91ed-4506-96dc-71b04b83f5da None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:11.789098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb9f33-91ed-4506-96dc-71b04b83f5da None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:11.794538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:11.795114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:11.795388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:11.795658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:11.804017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:11.805606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b824f80-e536-4593-af08-541f44ea3671 service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:11.815352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 754/1521] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:13.688501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8e45-1b6b-422b-8499-5a66a216ea35 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:13.689078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8e45-1b6b-422b-8499-5a66a216ea35 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:13.689078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c8e45-1b6b-422b-8499-5a66a216ea35 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:13.690397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:50:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:13.696388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf69b19-c038-49c2-8592-e52ab68937e3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:13.696788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf69b19-c038-49c2-8592-e52ab68937e3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:13.696900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf69b19-c038-49c2-8592-e52ab68937e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:13.716310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2cf69b19-c038-49c2-8592-e52ab68937e3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:13.717492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2cf69b19-c038-49c2-8592-e52ab68937e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:13.725185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:50:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:13.877481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8e45-1b6b-422b-8499-5a66a216ea35 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:13.891998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c8e45-1b6b-422b-8499-5a66a216ea35 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:13.897664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:13.898262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:13.898542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:13.898817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:13.907687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:13.909291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd8d7fa-6c46-4311-bf64-e077affe29fc service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:13.919514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 769/1524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:14.988938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3212e-a4db-4447-a6ac-cf24b46872e6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:14.989565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3212e-a4db-4447-a6ac-cf24b46872e6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:14.989565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e3212e-a4db-4447-a6ac-cf24b46872e6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:14.990808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Sep 20 04:50:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:14.998375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26dd0-7143-4897-859f-f48946d5fdeb None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:14.998819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26dd0-7143-4897-859f-f48946d5fdeb None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:14.999037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a26dd0-7143-4897-859f-f48946d5fdeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:15.021175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-19a26dd0-7143-4897-859f-f48946d5fdeb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:15.022380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-19a26dd0-7143-4897-859f-f48946d5fdeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:15.030115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Sep 20 04:50:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:50:15.180680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3212e-a4db-4447-a6ac-cf24b46872e6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:15.195332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e3212e-a4db-4447-a6ac-cf24b46872e6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:15.200779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:15.201366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:15.201644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:15.201917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:15.209800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:15.211359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b65af1-cad2-4a4e-a29c-b0a3f15cf3f2 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:15.221096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 757/1527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:19.189836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:19.190484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:19.190484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:19.191711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:50:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:19.197011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3444-691e-4c14-b401-79ad9a4b07fe None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:19.197429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3444-691e-4c14-b401-79ad9a4b07fe None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:19.197546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc3444-691e-4c14-b401-79ad9a4b07fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:19.217123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-66fc3444-691e-4c14-b401-79ad9a4b07fe None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:19.218311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-66fc3444-691e-4c14-b401-79ad9a4b07fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:19.226051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:50:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:19.511123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:19.512834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:19.590275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e983213a-3082-40f3-ad26-de9fd2f59e75 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:19.593805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:19.594402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:19.594680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:19.594949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:19.603619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:19.605105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e8c179-29ed-4111-a285-1d3e7549281c service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:19.614404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 772/1530] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:21.751965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:21.752528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:21.752528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:21.753863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:50:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:21.759090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45f4a-7e7a-4364-8adf-c2aabd696b75 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:21.759526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45f4a-7e7a-4364-8adf-c2aabd696b75 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:21.759627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb45f4a-7e7a-4364-8adf-c2aabd696b75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:21.784341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9fb45f4a-7e7a-4364-8adf-c2aabd696b75 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:21.785533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9fb45f4a-7e7a-4364-8adf-c2aabd696b75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:21.793825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:50:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:22.080836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:22.082518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:22.095955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda4e559-f54c-4994-abb1-26d0dd5025c1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:22.099422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:22.100045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:22.100325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:22.100864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:22.110124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:22.111534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d1d3112-99f4-446f-8aa2-ea69f2f88219 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:22.120776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 760/1533] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:25.904360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:25.904940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:25.904940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:25.906279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:50:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:25.911604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3abd1-0bf3-4709-a5ac-8fdc2a3c6568 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:25.912090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3abd1-0bf3-4709-a5ac-8fdc2a3c6568 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:25.912198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b3abd1-0bf3-4709-a5ac-8fdc2a3c6568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:25.931272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a8b3abd1-0bf3-4709-a5ac-8fdc2a3c6568 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:25.933014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a8b3abd1-0bf3-4709-a5ac-8fdc2a3c6568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:25.940927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:50:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:26.250089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:26.251724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:26.315454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:26.328801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594dd3bd-b680-4a29-852b-3388b2570571 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:26.332296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:26.332893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:26.333167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:26.333432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:26.342101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:26.343500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc00a158-7b0e-4ea2-a9fd-e1235b378e08 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:26.352596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 775/1536] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:28.497706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:28.498251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:28.498251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:28.499571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 917 bytes} [Tue Sep 20 04:50:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:50:28.504793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76508-a319-4a2a-8ae9-07ebf74e7864 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:28.505226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76508-a319-4a2a-8ae9-07ebf74e7864 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:28.505335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b76508-a319-4a2a-8ae9-07ebf74e7864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:28.525169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-68b76508-a319-4a2a-8ae9-07ebf74e7864 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:50:28.526425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-68b76508-a319-4a2a-8ae9-07ebf74e7864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:28.534092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Tue Sep 20 04:50:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:50:28.836814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:50:28.838977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:50:28.846498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=84 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:28.852753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bbc15-92c8-4bc6-abcd-6a80b10703f7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:50:28.856851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:50:28.857441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:50:28.857716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:50:28.857987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:50:28.866653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:50:28.868106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f448074-8f30-4eb7-987b-9177981adea8 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:50:28.877259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 763/1539] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:50:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:50:38.520312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=11 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:50:38.873181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:04.234966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2b6d-94c4-4a4b-ab2a-5e4280eff181 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.235960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2b6d-94c4-4a4b-ab2a-5e4280eff181 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.235960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbc2b6d-94c4-4a4b-ab2a-5e4280eff181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.269370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-cdbc2b6d-94c4-4a4b-ab2a-5e4280eff181 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.270851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cdbc2b6d-94c4-4a4b-ab2a-5e4280eff181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.282892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 777/1540] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 20 04:52:04.291794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0635b-cf94-4de1-abe1-4917e772cca6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.293442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0635b-cf94-4de1-abe1-4917e772cca6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.293442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd0635b-cf94-4de1-abe1-4917e772cca6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.293632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.293632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.293803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.317997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.319221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.324682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4dd0635b-cf94-4de1-abe1-4917e772cca6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.326263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4dd0635b-cf94-4de1-abe1-4917e772cca6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.336223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 778/1541] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:04.338821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.349697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9833ef4d-649d-4388-91e7-2ea2aeea4b63 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.350775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 764/1542] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.360306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.360927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.361204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.361474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.362121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:04.362420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.364156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58197b37-2477-4d44-8231-8afa873086e6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.380975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 779/1543] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:52:04.383165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.383446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.383717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.389308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743251af-284c-42fb-9441-c617a92b1559 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.389596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743251af-284c-42fb-9441-c617a92b1559 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.389931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743251af-284c-42fb-9441-c617a92b1559 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.419315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-743251af-284c-42fb-9441-c617a92b1559 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.420459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.420728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-743251af-284c-42fb-9441-c617a92b1559 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.421626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.438825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 765/1544] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:04.439647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.463226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 780/1545] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.464641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.464928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.465202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.474373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e623e2b-b414-4fe4-bfa8-19231064a125 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.489389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.489942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.490219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.490487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.491123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.493334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88530048-a6b4-4abb-859d-94620b098390 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.495593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.497027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.512786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 781/1546] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.513924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.535255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b2d2-b614-4c03-b3c7-8ab62e203bb2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.545842 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.546464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.546969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.547239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.547912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:04.548218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.550888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adea9776-3365-453e-8f77-783d94a3c17f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.567202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 782/1547] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:04.569007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49d13-99e3-4c17-8291-ece0d2ac8419 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.569508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49d13-99e3-4c17-8291-ece0d2ac8419 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.570065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b49d13-99e3-4c17-8291-ece0d2ac8419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.578661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 766/1548] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/projects => generated 377 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:04.580171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656fde-0b88-4af4-ad72-77acb59c966e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.580515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656fde-0b88-4af4-ad72-77acb59c966e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.580792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b656fde-0b88-4af4-ad72-77acb59c966e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.595931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-54b49d13-99e3-4c17-8291-ece0d2ac8419 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.597133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-54b49d13-99e3-4c17-8291-ece0d2ac8419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.600357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0b656fde-0b88-4af4-ad72-77acb59c966e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.602045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0b656fde-0b88-4af4-ad72-77acb59c966e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.658322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 783/1549] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.659828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c547c4-dd4c-40ff-b472-6b6478275eb7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.660149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c547c4-dd4c-40ff-b472-6b6478275eb7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.660492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c547c4-dd4c-40ff-b472-6b6478275eb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.673819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 767/1550] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.673819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.673819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.673819 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.682395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-15c547c4-dd4c-40ff-b472-6b6478275eb7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.683900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-15c547c4-dd4c-40ff-b472-6b6478275eb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.691922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 784/1551] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.693224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.693508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.693782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.695577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.696804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.708173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 768/1552] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.708173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.715441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.716074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e8b9c1-ca48-4464-8491-8bdafe3dbe5a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.716686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.720818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.721414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.721687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.721956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.722607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.724526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0669ccc8-31a3-42a0-b7d3-f0d011da69c3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.732390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 785/1553] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.732390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.735362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48df2258-b122-431b-ac40-55d6f820dde5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.740669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.741218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.741492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.741794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.742428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.744559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74798450-77f8-4887-a592-0c18c5bb7b3c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.761441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 769/1554] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/projects => generated 391 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:04.762834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.763119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.763404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.772004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 786/1555] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/users => generated 289 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:04.772004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.772004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.772004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.784489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.785693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.793031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.794210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.845278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 770/1556] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.848708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.853305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 787/1557] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.854147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.859622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115e963e-c888-471a-8737-9a0cfb2cbe13 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.863321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea36dd1-99ea-44c9-862d-b74c290ef485 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.864542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.865144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.865424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.865722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.866367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:04.866699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.867897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:04.867897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:52:04.867897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:52:04.868309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.868798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.868910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcda573a-c9d0-457d-afab-f145ae1f3e2b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.869075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.869341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.869979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:04.870277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.871886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3f8705-a418-4b63-beff-9daf550cf68b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.880302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 771/1558] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:04.881530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.881815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.882087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.889599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 788/1559] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:04.891385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.891667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.891958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.901265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:04.908249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.909531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.913516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.915203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.918083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 772/1560] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.918657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.923699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 789/1561] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.924514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.931306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac26723-2f0e-4108-bf4e-506754723968 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.933838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0d3430-4da7-4812-8190-b32060b20ecb None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.936273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.936905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.937184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.937460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.938123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.938393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.938964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.939135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:04.939135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:52:04.939135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:52:04.939365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.939530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.940152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.940386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.941721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a794a636-66c6-462f-9692-03c3b0c54c17 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:04.949507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:04.955037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 790/1562] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/roles => generated 1420 bytes in 27 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:04.955037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb467-f613-4c37-9101-1274d038c815 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.955037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb467-f613-4c37-9101-1274d038c815 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.955037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-246cb467-f613-4c37-9101-1274d038c815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.970587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 773/1563] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/users => generated 296 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:04.971426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.976741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-246cb467-f613-4c37-9101-1274d038c815 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:04.978205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-246cb467-f613-4c37-9101-1274d038c815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:04.982022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7da6e2-e871-4cca-97a9-21d9ccd15ed5 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:04.987237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:04.987921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:04.988197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:04.988464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:04.989871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:04.990180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:04.990770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 791/1564] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:04.991525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cb467-f613-4c37-9101-1274d038c815 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:04.992054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.002167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-246cb467-f613-4c37-9101-1274d038c815 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.006117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 774/1565] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:05.007819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.008424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.008638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.008765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.009113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.009756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.010769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:05.010769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:52:05.010769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:52:05.012037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.020689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a200a4e0-4f77-4a40-a573-9bc7f2ea8c9e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.026088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.026691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.026965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.027238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.027991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.029923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.046829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 792/1566] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:04 2022] POST /identity/v3/projects => generated 403 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.047664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.067462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 775/1567] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/projects => generated 385 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.067462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.117600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3dbed9-a8a1-4520-9f99-85cc37a50fac admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.136783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f450822e-27a9-4a02-9652-de010947d955 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.141820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.142427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.142703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.143000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.143642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:05.143972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.145571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.158279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 776/1568] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:05.159325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.174923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.175099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599ac585-8a7a-460f-b032-aae5ffd296d9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.175537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.175846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.176123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.176767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:05.177072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.178665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.179720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.180339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.180616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.181287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.181532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.183091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.190195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 793/1569] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:05.190985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.193052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 777/1570] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.193770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.200985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d504e21-e11d-4e17-ac45-dd7e836b924c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.204112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e9e239-e072-4272-bec3-44166b086d0d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.206131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.206723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.207002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.207273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.207951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.208704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.209289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.209539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.209662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.209830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.211012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:05.211317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.212919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.222187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 794/1571] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.223421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.225985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 778/1572] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:05.226761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.235392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98c77bd-f171-48d1-884b-100c5a3430ec admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.236133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08777b94-2cf5-44c4-a7fa-887ae645107e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.240044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.240656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.240762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.240980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.241194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.241291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.241528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.241797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.241892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.242415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.243709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.244325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.268423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 779/1573] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 302 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.269227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.276266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 795/1574] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/projects => generated 385 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.276266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.279855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad0c434-5f38-46f4-b7f5-98803a688937 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.305434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:05.339082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4bbf8c-c486-473c-833d-04d7100d36d1 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.340079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.340698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.340955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.341220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.341878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.343781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.343915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.344384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.344925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.344925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.345563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.347492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.360185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=9,keystone:SELECT=91 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:05.367258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 780/1575] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.370684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.377729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 796/1576] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.378648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.381289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261aedc4-c9e7-4dbc-bf27-6e322b2130af admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.440032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.440699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.440983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.441256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] PATH_INFO: `/v3/projects/9e7fa76656c24226a3f5787412b5b38a/users/3856f43e563a474d869fd7eceb8c53a4/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.445491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4c918-236c-46f3-850a-a4dc63dd127b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.450088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.450722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.451002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.451275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.451974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.453887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.456735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e7fa76656c24226a3f5787412b5b38a, user_id=3856f43e563a474d869fd7eceb8c53a4, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.459404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.474485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 781/1577] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:05 2022] PUT /identity/v3/projects/9e7fa76656c24226a3f5787412b5b38a/users/3856f43e563a474d869fd7eceb8c53a4/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:05.475622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.488068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 797/1578] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/projects => generated 373 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.489128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.539522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df712b92-83f9-41ab-bd61-7707ae9b1b51 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.550910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a60d44-41bc-4840-b0d1-61a0812756d4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.556054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.556658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.556939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.557214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.557845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.559755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.587487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 798/1579] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/projects => generated 387 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.588452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.594922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.595533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.595843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.596120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.596794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.598393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.608156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 782/1580] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.609199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.615740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:05.619760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45236287-ad4b-4a15-892e-a8abc47a2b74 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.640242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:05.655383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b0456-6386-4308-88e7-572859247562 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.660034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.660669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.660947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.661222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.661861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.663505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.673163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 799/1581] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.673945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.680506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.681124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.681404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.681675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.682309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.684312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116015e2-ef53-4a17-87b9-0065a5b610c4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.685930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3fff65-246c-4e9b-95dc-2d3caa9d7249 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.690813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.691389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.691662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.691986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.692768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.694474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.705529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 800/1582] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.706322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.708758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 783/1583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.710313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.710678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.710942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.715959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a9b62-7e89-4c00-8cde-bfa8fa2a5d04 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.720991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.721584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.721865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.722139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.722765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.724756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.729573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:05.730772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:05.739403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 784/1584] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:05.743191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.751042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 801/1585] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 292 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.751042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.751304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c985c39-2eee-4adb-9ba3-48d8ed64fbf0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.755810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.756406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.756690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.756955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.758147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.759713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80017fab-72a7-41d8-9c7e-474bddcb9579 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.760085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.764242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.764826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.765106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.765380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.766255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.768192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.781836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 785/1586] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 287 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.782632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.792984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08695670-64be-4f30-8699-b8cb35196201 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.793994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 802/1587] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:05 2022] POST /identity/v3/users => generated 294 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:05.794759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.800081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.800733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.801013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.801287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] PATH_INFO: `/v3/projects/195dc1d92dbc435e935c954243cfae36/users/c06f8365a64b4a0cbd22bc9c4b3da595/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.804929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98630ea6-6f6f-4201-ab1b-2cccf3fab6c4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.809523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.810107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.810642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.810642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.811307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.812961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.817187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] RBAC: Authorizing `identity:create_grant(project_id=195dc1d92dbc435e935c954243cfae36, user_id=c06f8365a64b4a0cbd22bc9c4b3da595, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.820300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.823604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 803/1588] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.824432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.836245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73bc4fe-89ac-40a6-bd7c-cd8f433ef565 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.837050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 786/1589] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:05 2022] PUT /identity/v3/projects/195dc1d92dbc435e935c954243cfae36/users/c06f8365a64b4a0cbd22bc9c4b3da595/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:05.837899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.896295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.896929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.897187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.897511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.898116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.899715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.900799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8d984f-7a98-489f-bad1-1ecd6bdbd66f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.905578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.906181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.906462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.906740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.907378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.909021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.909567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 804/1590] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.910534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.919559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 787/1591] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.920399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.930195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d979fbf-e641-4744-8427-b5f855402a52 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.934729 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.935303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.935585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.935892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.936518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.938088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.947778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 788/1592] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.948596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.964616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df137c40-7d4f-49f6-992b-89d360e93538 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.969408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.970024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.970304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.970578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.971217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.972736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4714c08a-3b87-4aec-a7de-2c34003aa25e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:05.972849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.976957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:05.977562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:05.977838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:05.978106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:05.984157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 789/1593] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:05.987166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:05.988671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:05.990135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:05.996179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:05.997084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe7e11e-fcc3-45d1-879d-e27d864ba704 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.001947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.002595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.002874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.003136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.003759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.004123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 805/1594] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:06.005030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.005442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17795d-6f39-4af9-b601-7bede2806840 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.018919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 790/1595] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:06.019111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb64904-69b1-4e74-becb-5436d2b4cf06 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.019235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.019235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.019235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.024028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.024697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.025199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.025320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] PATH_INFO: `/v3/projects/a517131c2473461f81eba0b4acc6068e/users/554f099d6583427b8c03d53d1643e84a/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.038198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.040122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.047952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 791/1596] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.048747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.055059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a517131c2473461f81eba0b4acc6068e, user_id=554f099d6583427b8c03d53d1643e84a, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.056144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:06.056144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:52:06.056144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:52:06.058175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.068613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f1ff45-e279-4abe-ba6e-24586bdfff65 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.072512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 806/1597] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/a517131c2473461f81eba0b4acc6068e/users/554f099d6583427b8c03d53d1643e84a/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.073338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.095108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:06.143242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.144140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.144421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.144697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] PATH_INFO: `/v3/projects/dac92c13f9e6476bb57be5a6dfd92cc5/users/d73f0d2de7da4537810e97fea468ee0f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.160638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20673c76-2450-41fc-b7ce-b22a8b8f0288 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.163193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac92c13f9e6476bb57be5a6dfd92cc5, user_id=d73f0d2de7da4537810e97fea468ee0f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.166446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.172726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.173565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.174056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.175157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.176071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.178180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.181787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 792/1598] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/dac92c13f9e6476bb57be5a6dfd92cc5/users/d73f0d2de7da4537810e97fea468ee0f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.182798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.193155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 807/1599] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:06.193155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.203803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732c61d0-0ba3-4150-9c95-21d1c81a3084 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.266498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.267141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a477e984-8ee8-432b-824f-1d997f42c8d6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.267266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.267353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.267615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.268283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.269883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.273429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.274738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.274738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.275168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.277032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.279188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.284293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 808/1600] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:06.284293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.294476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 793/1601] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:06.294476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.294738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad59424c-3b87-4496-a2e4-c70782389a5b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.298443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.299178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.299493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.299881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.300590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.302278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d474a8d7-86d3-477a-a1da-828820656f73 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.313390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 809/1602] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:06.314715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3248b-ab76-47db-a64b-ae187269f343 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.315073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3248b-ab76-47db-a64b-ae187269f343 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.315415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3248b-ab76-47db-a64b-ae187269f343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.346690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bbd3248b-ab76-47db-a64b-ae187269f343 None None] MFA Rules not processed for user `554f099d6583427b8c03d53d1643e84a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.348060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bbd3248b-ab76-47db-a64b-ae187269f343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.382244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296232d6-0a5a-4b09-89c8-0ea9db136c21 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.386641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.387294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.387565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.387875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.399287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.400754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.404956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:06.413402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 794/1603] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:06.414858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.424160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985edb90-f3c6-463d-ad09-b7220429e0cb service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.429146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.429868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.430151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.430417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] PATH_INFO: `/v3/projects/023983746cca40d78138cbb88ff63d17/users/1595ac20460d4b62b9f41462b61250cb/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.432589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 810/1604] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.434221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.434669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.434946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.451501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=023983746cca40d78138cbb88ff63d17, user_id=1595ac20460d4b62b9f41462b61250cb, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.454661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.476858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] MFA Rules not processed for user `d73f0d2de7da4537810e97fea468ee0f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.478347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.479804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 795/1605] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/023983746cca40d78138cbb88ff63d17/users/1595ac20460d4b62b9f41462b61250cb/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.482466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.507667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:06.558893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354320e5-2bcc-4417-afaf-1641be90abd1 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.562220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 811/1606] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.563045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.564359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.565211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.565610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.565888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] PATH_INFO: `/v3/projects/abeba54944f94d8f90fa340187af2412/users/d2778483496244bf9b7e200b5a1d4576/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.579600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362ae271-aa32-4755-a8e0-31f2de6b7e81 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.584478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abeba54944f94d8f90fa340187af2412, user_id=d2778483496244bf9b7e200b5a1d4576, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.588438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.588574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.589626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.589859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.590225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] PATH_INFO: `/v3/projects/067a6f7df14d48b99908387a5768bca6/users/c32d9ea3c6a44d15b2b050e99524b56e/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.611831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 796/1607] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/abeba54944f94d8f90fa340187af2412/users/d2778483496244bf9b7e200b5a1d4576/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.612929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=067a6f7df14d48b99908387a5768bca6, user_id=c32d9ea3c6a44d15b2b050e99524b56e, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.613302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.616354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.634100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 812/1608] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/067a6f7df14d48b99908387a5768bca6/users/c32d9ea3c6a44d15b2b050e99524b56e/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.635041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.695849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c074fa11-03bd-49fa-b2b2-ef968aa16372 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.708438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c28851e-a521-40ad-ab02-af1ce295dc81 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:06.714668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.714969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.715246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.715511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.716164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.718064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f039fdef-947c-4c3a-9bb8-80fa325f6754 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.753541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 813/1609] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/projects => generated 401 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:06.756169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8ea8-cb0d-492e-bfb9-112ff4b807ab None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.756777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8ea8-cb0d-492e-bfb9-112ff4b807ab None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.757873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ff8ea8-cb0d-492e-bfb9-112ff4b807ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.761302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:06.761968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.762245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.762514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] PATH_INFO: `/v3/projects/5e2359dc2fb14576a17dc062995d1630/users/65341da46cb04d5b898687920dcafc80/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.778081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e2359dc2fb14576a17dc062995d1630, user_id=65341da46cb04d5b898687920dcafc80, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:06.780969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325c9be9-332d-4f7e-bfca-519534f8e299 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:06.796845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d8ff8ea8-cb0d-492e-bfb9-112ff4b807ab None None] MFA Rules not processed for user `1595ac20460d4b62b9f41462b61250cb`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.798084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d8ff8ea8-cb0d-492e-bfb9-112ff4b807ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.799615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 797/1610] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:06 2022] PUT /identity/v3/projects/5e2359dc2fb14576a17dc062995d1630/users/65341da46cb04d5b898687920dcafc80/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:06.800918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989e81-9061-4a19-943a-faf2282d088b None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.801199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989e81-9061-4a19-943a-faf2282d088b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.801468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae989e81-9061-4a19-943a-faf2282d088b None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.803020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 798/1611] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 20 04:52:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:06.804126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.804405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.804683 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.831329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:06.840800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] MFA Rules not processed for user `d2778483496244bf9b7e200b5a1d4576`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.842045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.865422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:06.879262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 814/1612] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.881458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a676f1-6b44-4a56-994d-6bf1e392b399 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.881936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a676f1-6b44-4a56-994d-6bf1e392b399 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.883036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a676f1-6b44-4a56-994d-6bf1e392b399 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:06.909716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a6a676f1-6b44-4a56-994d-6bf1e392b399 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:06.911357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a6a676f1-6b44-4a56-994d-6bf1e392b399 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:06.921990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 799/1613] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.922831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:06.995618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 815/1614] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:06.995618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764839c8-4e3d-42a4-a728-429a6d60f39c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:06.995618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764839c8-4e3d-42a4-a728-429a6d60f39c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:06.995618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764839c8-4e3d-42a4-a728-429a6d60f39c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.009301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607b8076-9ded-4cb2-a83c-efc415a24cb3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.014453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.015194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.015453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.015837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.016659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.018750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.020090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-764839c8-4e3d-42a4-a728-429a6d60f39c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:07.021369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-764839c8-4e3d-42a4-a728-429a6d60f39c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:07.033795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 816/1615] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:07.033795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.033795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.033795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.043868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 800/1616] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:06 2022] POST /identity/v3/users => generated 307 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:07.043868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.053907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3704f014-bd8c-47a9-823f-bd278841ee24 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.059370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.059983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.060214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.060487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.061131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.063041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.090644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:07.092290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:07.099238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 801/1617] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:07 2022] POST /identity/v3/projects => generated 383 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:07.101680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.223171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801475ee-5b63-474b-894f-ee894892ca2b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.228811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 817/1618] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 20 04:52:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:07.230442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.231402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.231759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.232046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.232944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.240159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.242785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.274399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 802/1619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:07 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:07.279628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.305936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:07.326631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:07.355714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba5225-2052-4bea-8fcf-809b8e57a550 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.368308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa0f695-2229-4be6-b445-76e7413e1467 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.373198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.374356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.374634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.374907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.461281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.461971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.462248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.462520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.522612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.525345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.537350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 803/1620] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:07.539032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.548785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.550471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911fbd09-7e3b-401b-a2b3-1ca4c6d4ca15 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.550603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.556368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.557279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.557756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.558214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.559031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.561303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.569467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 818/1621] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:07.570871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.581963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 804/1622] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:07.583638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d151b-92fa-49d2-b930-3b2e70f07028 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.584045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.591008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.592159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.592444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.592714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.593437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.597008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.630483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 819/1623] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:07 2022] POST /identity/v3/users => generated 298 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:07.631178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.647420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f183ed4c-3b18-4cf7-b74b-75b90f742316 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.653701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.654361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.654645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.654964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.655655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.658074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.687766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfd07f3-0366-4ca0-aa62-5e51d0d234e8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.692573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 820/1624] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:07 2022] POST /identity/v3/users => generated 293 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:07.693965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.698208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.698969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.699255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.699525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.708412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-020b787e-11d7-4f1e-b01d-f733cb8c8f33 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.715886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.717521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.718006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.718483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] PATH_INFO: `/v3/projects/334d7fb6522046489ed0c836b070daa4/users/6cbbc40f26a148648bc8314f9ad57abb/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.739070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334d7fb6522046489ed0c836b070daa4, user_id=6cbbc40f26a148648bc8314f9ad57abb, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.743427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.772636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 821/1625] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:07 2022] PUT /identity/v3/projects/334d7fb6522046489ed0c836b070daa4/users/6cbbc40f26a148648bc8314f9ad57abb/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:07.773837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.785283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:07.808543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.810189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.829355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 805/1626] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:07.830085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:07.853713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00eb61c-d28c-4f58-b30a-6464f138a6c6 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.907325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:07.970624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8617542f-71a2-46fc-a70e-ce7d1e0b6bb6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:07.977021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.977841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.977958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.978183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.978859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:07.980580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:07.988260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:07.992467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:07.994978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:07.996475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:07.999183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.008061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 806/1627] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:08.008061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.008975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.028516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1976336-279a-4b88-af54-5669d2d99422 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.041464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.042123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.042725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.042725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.043285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.045403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.050226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 822/1628] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:07 2022] GET /identity/v3/roles => generated 1420 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:08.057436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.065399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 807/1629] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:08.066286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.079119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d15bca-2270-46e4-a6df-54bbe494ecec admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.086832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.087690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.088062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.088344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] PATH_INFO: `/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d/users/359c681e650d4bb88d95a5138f03a208/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.095246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81965bd0-ca6c-45a2-9323-a576d044e6a2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.108051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a0393211cc4d7f8f6028ba8cc8f65d, user_id=359c681e650d4bb88d95a5138f03a208, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.111298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.121998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.122698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.125817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.126118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] PATH_INFO: `/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de/users/639c47f30ad74debadd7f220bd751d31/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.136121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 808/1630] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:08 2022] PUT /identity/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d/users/359c681e650d4bb88d95a5138f03a208/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:08.138186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.181175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534b2c6d7814c4caeb6fe35f5f6c5de, user_id=639c47f30ad74debadd7f220bd751d31, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.188627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.217494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 823/1631] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:08 2022] PUT /identity/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de/users/639c47f30ad74debadd7f220bd751d31/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:08.220894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.286070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450cd3df-3ce9-4b1e-8dc0-735aa0b3c61e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.353778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abfc04bd-13b1-43fa-8d75-d52745f0a597 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.368929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.371859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.371859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.371859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.371859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.373763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.408255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 824/1632] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:08.408993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.429528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.430621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.431095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.431546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] PATH_INFO: `/v3/projects/334d7fb6522046489ed0c836b070daa4/users/6cbbc40f26a148648bc8314f9ad57abb/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.439817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] RBAC: Authorizing `identity:create_grant(project_id=334d7fb6522046489ed0c836b070daa4, user_id=6cbbc40f26a148648bc8314f9ad57abb, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.442761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.444238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32f56d6-b157-4688-b10b-bc5cb4d5ddbe admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.448350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:08.457420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.458841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.459128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.459403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.460102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.467722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99ab2f-98c8-4a94-89cd-01b750e73656 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.478587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 809/1633] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:08 2022] PUT /identity/v3/projects/334d7fb6522046489ed0c836b070daa4/users/6cbbc40f26a148648bc8314f9ad57abb/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:08.478587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.504791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 825/1634] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:08 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:08.507250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfec9-bceb-4bf2-a31b-3a5146c1001c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.507536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfec9-bceb-4bf2-a31b-3a5146c1001c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.507836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ccfec9-bceb-4bf2-a31b-3a5146c1001c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.576881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-58ccfec9-bceb-4bf2-a31b-3a5146c1001c None None] MFA Rules not processed for user `6cbbc40f26a148648bc8314f9ad57abb`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:08.578023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-58ccfec9-bceb-4bf2-a31b-3a5146c1001c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:08.599807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c503ffab-4563-4b45-a77c-e3fe91df2683 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.608752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.610476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.610957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.611412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] PATH_INFO: `/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d/users/359c681e650d4bb88d95a5138f03a208/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.614926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14a0393211cc4d7f8f6028ba8cc8f65d, user_id=359c681e650d4bb88d95a5138f03a208, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.618784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.659439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 810/1635] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:08 2022] PUT /identity/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d/users/359c681e650d4bb88d95a5138f03a208/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:08.660397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.706921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 826/1636] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:08.715439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76cd2-4546-4157-9773-1618d404fb31 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.715766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76cd2-4546-4157-9773-1618d404fb31 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.716069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf76cd2-4546-4157-9773-1618d404fb31 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.717554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 827/1637] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 20 04:52:08 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:08.724955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f07-523f-40c8-984d-2733e12b2e21 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.725282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f07-523f-40c8-984d-2733e12b2e21 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.725571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea32f07-523f-40c8-984d-2733e12b2e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.770036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4ea32f07-523f-40c8-984d-2733e12b2e21 None None] MFA Rules not processed for user `359c681e650d4bb88d95a5138f03a208`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:08.771412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4ea32f07-523f-40c8-984d-2733e12b2e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:08.794123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:08.814956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd361e15-2e27-4748-a809-a12f9f1502e2 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.821652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.822413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.822757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.823094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] PATH_INFO: `/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de/users/639c47f30ad74debadd7f220bd751d31/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.825150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9534b2c6d7814c4caeb6fe35f5f6c5de, user_id=639c47f30ad74debadd7f220bd751d31, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:08.827911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:08.843860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 811/1638] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:08 2022] PUT /identity/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de/users/639c47f30ad74debadd7f220bd751d31/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:08.843860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:08.929871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 828/1639] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:08.936932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.936932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.936932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:08.949399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-765127f3-3dbc-474d-aed3-0e667b31444c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:08.954912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:08.955943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:08.956451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:08.957026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.006335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:09.009803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:09.030290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:09.092463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:09.098856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98048ebb-e0b9-40a6-bfb3-e615044e6e21 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:09.124770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 812/1640] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:08 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:09.128768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.129108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.130494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.200717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] MFA Rules not processed for user `639c47f30ad74debadd7f220bd751d31`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:09.202297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 829/1641] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:52:08 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:09.202448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:09.202952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:09.227943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3c4a46-e85a-4426-a608-d2f869b465a7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:09.232114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:09.232262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.232510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.232726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.302608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 813/1642] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:09.306730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:09.323453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88be035e-7f3e-4802-871d-56b424786df0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:09.328535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:09.329136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.329410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.329684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.343138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:09.344158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:09.345603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:09.346053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:09.357922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 830/1643] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:09.371997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 814/1644] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:09.395297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:09.511664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:09.546569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:09.565357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ec8f6-2c96-4c23-bbae-28e3d6b9bffa service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:09.567161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-899df7ff-bd53-4f0c-bbc5-f3b9af7f0aa9 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:09.576408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:09.577099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.577444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.578320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.581622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:09.582289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.582566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.582838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] PATH_INFO: `/v3/users/1595ac20460d4b62b9f41462b61250cb` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.584285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1595ac20460d4b62b9f41462b61250cb)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:09.586213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: WARNING py.warnings [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:09.586213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: warnings.warn(msg) Sep 20 04:52:09.586213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: Sep 20 04:52:09.587579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:09.603050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:09.606577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9007e0-4071-4179-abc0-3c047bd4d982 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:09.643526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 815/1645] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:09 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:09.780390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1595ac20460d4b62b9f41462b61250cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:09.784529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1595ac20460d4b62b9f41462b61250cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:09.786428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1595ac20460d4b62b9f41462b61250cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:09.821125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1595ac20460d4b62b9f41462b61250cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:09.898857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1595ac20460d4b62b9f41462b61250cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:09.930211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 831/1646] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:09 2022] DELETE /identity/v3/users/1595ac20460d4b62b9f41462b61250cb => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:09.940498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:09.940784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:09.941051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:09.985543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:09.986891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.006580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:10.008287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.171123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 816/1647] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:10.175261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:10.180469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.227509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e9900b-fb1a-4e02-8a4d-ffbd2356308c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:10.244139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:10.244977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:10.245066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:10.245311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] PATH_INFO: `/v3/users/554f099d6583427b8c03d53d1643e84a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:10.248220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] RBAC: Authorizing `identity:delete_user(user_id=554f099d6583427b8c03d53d1643e84a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:10.255304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:10.303191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:10.422804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '554f099d6583427b8c03d53d1643e84a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:10.519833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '554f099d6583427b8c03d53d1643e84a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:10.519833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '554f099d6583427b8c03d53d1643e84a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:10.520455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19bde12-5b81-4ec0-9b65-cebb9fc9a030 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:10.520954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '554f099d6583427b8c03d53d1643e84a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:10.521857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:10.521857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:10.521857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:10.521857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:10.523820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:10.524030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.536043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '554f099d6583427b8c03d53d1643e84a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:10.592127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 832/1648] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:10 2022] DELETE /identity/v3/users/554f099d6583427b8c03d53d1643e84a => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:10.594389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:10.598515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.620156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:10.622180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b142b28-662b-48da-a37d-ad7aaeaa3cd7 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:10.659388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 817/1649] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:10.662644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:10.662937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:10.663219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:10.724327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:10.728358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.805964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0e52a-6cfa-45ee-aad1-d77e45992e1b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:10.815498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:10.822038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:10.824163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:10.824548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:10.832460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:10.930085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 818/1650] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:10.952242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:10.965493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74da79e4-8014-45a0-825c-77edb7fba33c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:10.977377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:10.979419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:10.980484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:10.981516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.017882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:11.022088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:11.023948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0fb8d6-f529-4565-95cd-cee95f3718e4 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:11.024078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79119555-ea5d-45de-a37d-de78beba1c09 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:11.045856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 833/1651] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:11.058913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 819/1652] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:11.160694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07682e-cc89-429c-b8af-4928ac933daa None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:11.161249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07682e-cc89-429c-b8af-4928ac933daa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:11.161819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b07682e-cc89-429c-b8af-4928ac933daa None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.165060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 834/1653] 10.222.0.42 () {54 vars in 965 bytes} [Tue Sep 20 04:52:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:11.174705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a8be-19db-4414-a4d8-550f46ef18a1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:11.175336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a8be-19db-4414-a4d8-550f46ef18a1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:11.175617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c9a8be-19db-4414-a4d8-550f46ef18a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.209036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a0c9a8be-19db-4414-a4d8-550f46ef18a1 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:11.210836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a0c9a8be-19db-4414-a4d8-550f46ef18a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:11.372117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 820/1654] 10.222.0.42 () {58 vars in 1062 bytes} [Tue Sep 20 04:52:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:11.372622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:11.372622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:11.372622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.372622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 835/1655] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 20 04:52:11 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:52:11.374956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:11.374956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:11.374956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.374956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:11.384612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:11.389229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:11.410992 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 821/1656] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:52:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:11.426006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:11.428538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:11.554788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a1f66-1dab-424a-8960-e85237da6554 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:11.563026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:11.563705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:11.564137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:11.564411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:11.594324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:11.604280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:11.629176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 836/1657] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:11 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:13.318844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:13.322529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:13.334562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:13.337301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:13.368991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b612e5e6-6f20-45a0-9b7e-72a553a61112 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:13.371437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6fb651-bb2c-40a9-9f3d-c5dc14d023f9 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:13.387339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:13.388027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:13.392065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:13.392399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] PATH_INFO: `/v3/projects/a517131c2473461f81eba0b4acc6068e` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:13.394006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:13.398740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a517131c2473461f81eba0b4acc6068e)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:13.401358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: WARNING py.warnings [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 20 04:52:13.401358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: warnings.warn(msg) Sep 20 04:52:13.401358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: Sep 20 04:52:13.402711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:13.403185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:13.403599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] PATH_INFO: `/v3/projects/023983746cca40d78138cbb88ff63d17` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:13.411175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:13.412256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=023983746cca40d78138cbb88ff63d17)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:13.421118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:13.536105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:13.604539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '023983746cca40d78138cbb88ff63d17', 'request_id': 'req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.631051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '023983746cca40d78138cbb88ff63d17', 'request_id': 'req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.644645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a517131c2473461f81eba0b4acc6068e', 'request_id': 'req-b3f6e660-f55c-48ef-8939-694481410ad4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.654011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '023983746cca40d78138cbb88ff63d17', 'request_id': 'req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.681239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] The token cache is being invalidate because project 023983746cca40d78138cbb88ff63d17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:13.681554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.681919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a517131c2473461f81eba0b4acc6068e', 'request_id': 'req-b3f6e660-f55c-48ef-8939-694481410ad4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.683415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.687094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 837/1658] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:13 2022] DELETE /identity/v3/projects/023983746cca40d78138cbb88ff63d17 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:13.690346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:13.692322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:13.698304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a517131c2473461f81eba0b4acc6068e', 'request_id': 'req-b3f6e660-f55c-48ef-8939-694481410ad4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.726434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] The token cache is being invalidate because project a517131c2473461f81eba0b4acc6068e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:13.726737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.728163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:13.735688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 822/1659] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:13 2022] DELETE /identity/v3/projects/a517131c2473461f81eba0b4acc6068e => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:13.739522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:13.743047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:13.875972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a7fb74-8bf1-40dd-b3b2-c1c000910b04 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:13.942485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6e660-f55c-48ef-8939-694481410ad4 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:13.981757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:13.982363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:13.983807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:13.983807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] PATH_INFO: `/v3/users/6cbbc40f26a148648bc8314f9ad57abb` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:13.998293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] RBAC: Authorizing `identity:delete_user(user_id=6cbbc40f26a148648bc8314f9ad57abb)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:14.000439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:14.064406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:14.065159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:14.065433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:14.065739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] PATH_INFO: `/v3/users/359c681e650d4bb88d95a5138f03a208` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:14.066993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=359c681e650d4bb88d95a5138f03a208)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:14.069210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:14.094744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6cbbc40f26a148648bc8314f9ad57abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.096162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6cbbc40f26a148648bc8314f9ad57abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.097555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6cbbc40f26a148648bc8314f9ad57abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.136524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6cbbc40f26a148648bc8314f9ad57abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.146082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6cbbc40f26a148648bc8314f9ad57abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.162484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:14.184184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 823/1660] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:13 2022] DELETE /identity/v3/users/6cbbc40f26a148648bc8314f9ad57abb => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:14.192821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '359c681e650d4bb88d95a5138f03a208'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.195183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '359c681e650d4bb88d95a5138f03a208'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.196276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '359c681e650d4bb88d95a5138f03a208'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.214691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '359c681e650d4bb88d95a5138f03a208'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.230461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:14.243467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '359c681e650d4bb88d95a5138f03a208'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:14.283761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 838/1661] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:13 2022] DELETE /identity/v3/users/359c681e650d4bb88d95a5138f03a208 => generated 0 bytes in 591 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:16.828442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:16.831043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.058591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085c9a1-058e-4b71-be60-18e63f0bedca admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:17.076343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:17.077893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.217821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:17.232313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.234665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.235220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] PATH_INFO: `/v3/users/d73f0d2de7da4537810e97fea468ee0f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.239100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73f0d2de7da4537810e97fea468ee0f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:17.245427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:17.327229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ee48616-e2cf-48b8-be79-f155afc23e1c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:17.343122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:17.343847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.344174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.344508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] PATH_INFO: `/v3/projects/334d7fb6522046489ed0c836b070daa4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.347291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=334d7fb6522046489ed0c836b070daa4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:17.349729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:17.409056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73f0d2de7da4537810e97fea468ee0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.411186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73f0d2de7da4537810e97fea468ee0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.415191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73f0d2de7da4537810e97fea468ee0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.473318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73f0d2de7da4537810e97fea468ee0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.498301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6f7fe6d3-ddb9-44d7-8d6a-d05ca9d2dfbc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73f0d2de7da4537810e97fea468ee0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.504488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '334d7fb6522046489ed0c836b070daa4', 'request_id': 'req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.528977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '334d7fb6522046489ed0c836b070daa4', 'request_id': 'req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.532747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 824/1662] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:16 2022] DELETE /identity/v3/users/d73f0d2de7da4537810e97fea468ee0f => generated 0 bytes in 702 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:17.537119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1573-3dd2-40af-aac7-b55bfb82fcb6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.537570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1573-3dd2-40af-aac7-b55bfb82fcb6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.538132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ab1573-3dd2-40af-aac7-b55bfb82fcb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.549822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '334d7fb6522046489ed0c836b070daa4', 'request_id': 'req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.581706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] The token cache is being invalidate because project 334d7fb6522046489ed0c836b070daa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:17.581706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.581965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25201e1a-b4d4-4ed6-8fe6-0c3b455382e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:17.588124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 839/1663] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:17 2022] DELETE /identity/v3/projects/334d7fb6522046489ed0c836b070daa4 => generated 0 bytes in 509 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:17.589445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.589727 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.589998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.591833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-45ab1573-3dd2-40af-aac7-b55bfb82fcb6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:17.595263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-45ab1573-3dd2-40af-aac7-b55bfb82fcb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.638432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:17.639792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.648172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:17.761440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 825/1664] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:17.779245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 840/1665] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:17.788959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.789359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.789744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.822592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:17.824202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.837030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 826/1666] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:17.840185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:17.856043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5917b5d1-0cc6-4045-a367-fe27ae0dc2ba None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:17.865494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:17.867945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.868368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.869612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.872914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:17.873570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:17.875235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:17.899519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:17.912808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 841/1667] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:52:17.917511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:17.927880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec90ec0-76aa-48fc-9517-c680c26fea7e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:17.943893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:17.945616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:17.946068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:17.946902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:17.949054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:17.949178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:17.952698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:17.954974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.059552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 827/1668] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:17 2022] POST /identity/v3/projects => generated 365 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:18.061393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.062676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cebc16b-ee37-46c3-bb47-f42dba0b80ff admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:18.212804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:18.213561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.213728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.213993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.230618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bae2940-9627-47e6-b38b-99d7d5f6be67 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:18.240144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:18.241615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.244112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:18.244757 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.245106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.245431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.257348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:18.262326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.265221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 842/1669] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:18.323906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 828/1670] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:18 2022] POST /identity/v3/users => generated 283 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:18.329686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.342092 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1c9842-cf53-4084-9037-ee64013d40c0 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:18.360361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:18.361212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.361725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.362101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.363045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:18.364849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.429643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 843/1671] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:18.431432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.450953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3f6523-cc5c-4a65-9f6d-f00dcd4c3058 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:18.461954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:18.462615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.462897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.463173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.468833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:18.473764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea6805-0320-422d-a1c4-b6dd97b0cb25 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.507565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 829/1672] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:18 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:18.511953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.541344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9ee53-786f-4d43-a0b2-bc4eb0082fb7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:18.557214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:18.558279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.558680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.559070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] PATH_INFO: `/v3/projects/e413abd2059d4108a98f6c47af276f9e/users/0a0a27668b61403fb80d9570dfab8f2e/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.598058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e413abd2059d4108a98f6c47af276f9e, user_id=0a0a27668b61403fb80d9570dfab8f2e, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:18.602386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:18.642427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:18.642725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:18.643006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:18.649862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 844/1673] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:18 2022] PUT /identity/v3/projects/e413abd2059d4108a98f6c47af276f9e/users/0a0a27668b61403fb80d9570dfab8f2e/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:18.713238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] MFA Rules not processed for user `0a0a27668b61403fb80d9570dfab8f2e`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:18.723850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:18.906534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 830/1674] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:18 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:18.911494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.936080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:18.937644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:18.962381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:19.108328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cb427a-ddd4-4b0a-933e-2195cf2b26b4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.110024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb070459-c619-4f75-ab25-d07c79259671 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.117900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.119900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.120202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.120482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] PATH_INFO: `/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.122476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14a0393211cc4d7f8f6028ba8cc8f65d)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.126291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.132482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.135864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.136937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.138936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.139866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.145641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.221928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 845/1675] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:18 2022] POST /identity/v3/projects => generated 365 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:19.226691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:19.248107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:19.270533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14a0393211cc4d7f8f6028ba8cc8f65d', 'request_id': 'req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:19.289203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14a0393211cc4d7f8f6028ba8cc8f65d', 'request_id': 'req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:19.310155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14a0393211cc4d7f8f6028ba8cc8f65d', 'request_id': 'req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:19.340788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] The token cache is being invalidate because project 14a0393211cc4d7f8f6028ba8cc8f65d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:19.344037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:19.345971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb03cc82-3d0c-43ab-a4cf-d2986b607f85 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:19.352725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 831/1676] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:18 2022] DELETE /identity/v3/projects/14a0393211cc4d7f8f6028ba8cc8f65d => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:19.354638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be066-8f08-4b74-8ecb-c28528c288da None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.354974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be066-8f08-4b74-8ecb-c28528c288da None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.355256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89be066-8f08-4b74-8ecb-c28528c288da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.399415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3652f6-6b61-459e-93f1-67082f074bd7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.432467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f89be066-8f08-4b74-8ecb-c28528c288da None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:19.440133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f89be066-8f08-4b74-8ecb-c28528c288da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:19.588347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.589236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.589561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.589833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.590559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.598635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43347420-8d2a-4642-b550-c68e9b86bb41 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.599583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 832/1677] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:19.609358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.609984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.610684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.658897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:19.674261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:19.682097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 846/1678] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/users => generated 289 bytes in 456 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:19.706243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.706644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.706989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.718113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 833/1679] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:19.722710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:19.728021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:19.750407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c150ae44-8ddf-457b-9cf0-3fe3cbbc0845 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.766593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.767221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.767493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.767776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.768430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.771287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.780037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] MFA Rules not processed for user `3856f43e563a474d869fd7eceb8c53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:19.781315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:19.790175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 834/1680] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:19 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:19.791069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:19.816949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b383f261-4e22-4ef0-ad4b-32405deec9d9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.825366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.826086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.826467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.826806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.827459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:19.827785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.830035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.855524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 835/1681] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:19.856748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:19.872678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274537c5-84f8-45c3-b13f-07b6e3754976 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.881040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:19.881989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.882562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.882953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] PATH_INFO: `/v3/projects/c106b7132098488eb44104106c987616/users/87a256b6dd62463697644a03eea38423/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:19.888213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:19.923347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 847/1682] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:19.924736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:19.933509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c106b7132098488eb44104106c987616, user_id=87a256b6dd62463697644a03eea38423, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:19.936325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b81f91-7885-4cbc-b1b7-1fc65c0a6fb3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:19.965542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ecf901-2b30-4a5d-b328-942a3574a765 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:19.969001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 836/1683] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:19 2022] PUT /identity/v3/projects/c106b7132098488eb44104106c987616/users/87a256b6dd62463697644a03eea38423/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:19.969001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:19.969001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:19.969001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.017207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:20.036989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] MFA Rules not processed for user `3856f43e563a474d869fd7eceb8c53a4`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:20.038820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:20.066927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.068132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.068635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.069918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.070770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.073097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.127907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 848/1684] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/projects => generated 379 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:20.129289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.176856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 837/1685] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:20.177701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.200868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ce7981-226a-4aea-9a13-befa62c1c2fb None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.282290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506c432-87f1-4532-92ce-68163bc114e3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.296828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.297634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.298003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.298705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.299132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.300920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.329671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 849/1686] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:20.329671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.333986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:20.396574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.397318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.397517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.397794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.398440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.400441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.474982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 838/1687] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:20 2022] POST /identity/v3/users => generated 290 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:20.476654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.500648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4353e24f-cc30-4a37-a1d2-263906b788fb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.513547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.514499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.514917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.515411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] PATH_INFO: `/v3/projects/c106b7132098488eb44104106c987616/users/87a256b6dd62463697644a03eea38423/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.527244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c106b7132098488eb44104106c987616, user_id=87a256b6dd62463697644a03eea38423, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.530207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.554911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35460b38-1b63-4e9a-8786-49387245d86a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.575534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.576114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.576387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.576662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.594217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 839/1688] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:20 2022] PUT /identity/v3/projects/c106b7132098488eb44104106c987616/users/87a256b6dd62463697644a03eea38423/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:20.594799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.693909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:20.726573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.728247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49281ec2-a5ac-41a5-8e81-066cf3ccd929 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.764971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930dd2c-033f-4668-9f53-f133f66193cb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.776289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 850/1689] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:20 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:20.792961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.793594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.793860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.794125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.794782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.796556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.804848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b222c4-3e03-4dc9-aa87-ec790c287b58 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.809303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b222c4-3e03-4dc9-aa87-ec790c287b58 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.809303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b222c4-3e03-4dc9-aa87-ec790c287b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.819855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:20.840168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 840/1690] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:20 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:20.844680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:20.853498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:20.874234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3acbe4c2-0e9e-4284-97f0-799cbdfcac42 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:20.893764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:20.894485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:20.894848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:20.895126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] PATH_INFO: `/v3/projects/dac92c13f9e6476bb57be5a6dfd92cc5` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:20.896415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac92c13f9e6476bb57be5a6dfd92cc5)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:20.900019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:20.928968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-75b222c4-3e03-4dc9-aa87-ec790c287b58 None None] MFA Rules not processed for user `87a256b6dd62463697644a03eea38423`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:20.930228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-75b222c4-3e03-4dc9-aa87-ec790c287b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.010774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac92c13f9e6476bb57be5a6dfd92cc5', 'request_id': 'req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:21.024077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac92c13f9e6476bb57be5a6dfd92cc5', 'request_id': 'req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:21.032577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac92c13f9e6476bb57be5a6dfd92cc5', 'request_id': 'req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:21.064960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] The token cache is being invalidate because project dac92c13f9e6476bb57be5a6dfd92cc5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:21.066100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:21.066949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:21.069913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 841/1691] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:20 2022] DELETE /identity/v3/projects/dac92c13f9e6476bb57be5a6dfd92cc5 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:21.070734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:21.072947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.111675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 851/1692] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:20 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 319 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:21.115118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.120543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.120906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.201756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c71d8f2-e9c1-4f22-ba5d-71cc9da8796c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:21.204697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] MFA Rules not processed for user `c06f8365a64b4a0cbd22bc9c4b3da595`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:21.205857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.216150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:21.218025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.218482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.219979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.221270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:21.224874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9797fa5-04f0-4f41-ba78-06c52a94f3e4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:21.257234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 842/1693] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:21 2022] GET /identity/v3/roles => generated 1420 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:21.261761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.263240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.265223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.376881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:21.383224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.409530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 852/1694] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:21.419517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 843/1695] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:21.420627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:21.420739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:21.430281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.458592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82223d6a-83b8-4960-99d8-d1edb738ca08 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:21.470746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:21.473199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.473783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.474717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] PATH_INFO: `/v3/projects/ac3615bb5b224027a8a611096582ae7e/users/acf6de96d5ab4426a9fbd1f1d13400e1/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.518586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ac3615bb5b224027a8a611096582ae7e, user_id=acf6de96d5ab4426a9fbd1f1d13400e1, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:21.523447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef467f9-46af-44c6-86ff-48c07a3659bb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:21.561418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 844/1696] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:21 2022] PUT /identity/v3/projects/ac3615bb5b224027a8a611096582ae7e/users/acf6de96d5ab4426a9fbd1f1d13400e1/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:21.561418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae8a9-de2d-43c8-9350-f6ad88f7d077 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.561418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae8a9-de2d-43c8-9350-f6ad88f7d077 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.561418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaae8a9-de2d-43c8-9350-f6ad88f7d077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.584311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20a9d3-2b92-4eb7-a76d-724e657edb58 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:21.610906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1eaae8a9-de2d-43c8-9350-f6ad88f7d077 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:21.614146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1eaae8a9-de2d-43c8-9350-f6ad88f7d077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:21.630809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:21.740226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:21.752084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:21.755661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.756449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.759664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.785664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 845/1697] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:21.785664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee93-201d-4ce4-a23f-065796f157ef None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:21.785664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee93-201d-4ce4-a23f-065796f157ef None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:21.785664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fcee93-201d-4ce4-a23f-065796f157ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:21.846035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-60fcee93-201d-4ce4-a23f-065796f157ef None None] MFA Rules not processed for user `c06f8365a64b4a0cbd22bc9c4b3da595`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:21.848328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-60fcee93-201d-4ce4-a23f-065796f157ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:22.011161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.013906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.069799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 846/1698] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:21 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:22.074892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9f43-0ae6-4335-b66e-c3e0af84b9db None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.075592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9f43-0ae6-4335-b66e-c3e0af84b9db None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.077408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edab9f43-0ae6-4335-b66e-c3e0af84b9db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.114342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 853/1699] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 704 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:22.121732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.185857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-edab9f43-0ae6-4335-b66e-c3e0af84b9db None None] MFA Rules not processed for user `acf6de96d5ab4426a9fbd1f1d13400e1`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:22.187097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-edab9f43-0ae6-4335-b66e-c3e0af84b9db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:22.199515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb1f663-7a1f-4cc8-bfd7-c6d5e26283ff service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.213308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:22.218159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.218757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.219045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.219766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:22.221894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.227173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.251603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 854/1700] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:22.252675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.257000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:22.336132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 847/1701] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:22.338175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a95f2-2096-40f1-8b42-f8786fe894b0 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.338455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a95f2-2096-40f1-8b42-f8786fe894b0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.338723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66a95f2-2096-40f1-8b42-f8786fe894b0 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.347186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 848/1702] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 20 04:52:22 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:22.348232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a95f2-2096-40f1-8b42-f8786fe894b0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.376600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66a95f2-2096-40f1-8b42-f8786fe894b0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.386814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:22.387617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.387937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.388258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.390063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.394946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.417186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1809369f-d5eb-4415-b391-40bcb9164b8b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.433072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:22.433946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.435366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.435823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.466764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 849/1703] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:22 2022] POST /identity/v3/projects => generated 363 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:22.468337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.477052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.478699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.505809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 855/1704] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:22 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:22.520747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.553005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a54fb3e-40c7-4377-aed9-d961c87ebdbd service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.591628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b238eac1-8a59-42da-9326-18a34dc99588 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.602405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:22.603138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.603672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.604113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.617553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:22.665190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:22.704563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:22.757759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:22.760558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.760847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.761129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.761805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.785983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e02e95-48e7-46de-b39d-84fe6a0e754d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.821475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:22.829421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 856/1705] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:22 2022] POST /identity/v3/projects => generated 381 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:22.832452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:22.832794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:22.832794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:22.832794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:22.869442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 850/1706] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:22 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:22.874642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:22.903716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfedb0d7-feba-44db-80cb-0cf2c8c7b3ba service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:22.951057 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:22.956379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:23.132042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.137519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.137820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.138099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.143323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.149917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.153678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 857/1707] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:52:22 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:23.156254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.182302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ee5581-9ca7-412e-b260-92809b0b937c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.214374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.217172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.217515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.219693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.221047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.230184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.243322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 851/1708] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:22 2022] POST /identity/v3/users => generated 282 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:23.246217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.254324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:23.323759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6665d7-000e-4dfc-95d4-b6eabe3488e0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.325374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 858/1709] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:23 2022] POST /identity/v3/users => generated 297 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:23.326688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.338030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.338696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.338924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.339218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.349827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4306d6-f1ee-46c9-9fca-03ead0cd7eb7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.349937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.351393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0298b5ec-6166-4c36-8166-d5deb8770a6f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.355408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.356401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.357110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.357557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.358383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.360402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c2acf5d-28d4-4ce2-8ebb-9a953decd24f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.370705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 852/1710] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:23.372175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210922f-c41c-4924-829f-98ceb0256a8c None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.373914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210922f-c41c-4924-829f-98ceb0256a8c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.374213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0210922f-c41c-4924-829f-98ceb0256a8c None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.377349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 853/1711] 10.222.0.42 () {54 vars in 912 bytes} [Tue Sep 20 04:52:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:23.378316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210922f-c41c-4924-829f-98ceb0256a8c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.398985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0210922f-c41c-4924-829f-98ceb0256a8c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.406979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 859/1712] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:23.408875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.409009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.409516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.409741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.409896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.410009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.410952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.413152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.415503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.448737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 854/1713] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:23.450154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.465124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407bfe43-582d-4f53-adbf-02479e793c56 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.465504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:23.466743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:23.504492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.504963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.505180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.505403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.505705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 860/1714] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:23.506068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.508615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.515927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.529528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 855/1715] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:23.533576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.545334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0575e3-b651-4c0b-9ac9-b1bc0b1e3504 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.547777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400c07f6-207e-417a-ac62-b00f16c88dbc None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.550858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.554038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.554562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.555109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] PATH_INFO: `/v3/projects/c8d0b0fab0d547f3bfdb75c33a31ffb6/users/bb571277f28d489884499cb297276547/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.561279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.562075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.562421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.562699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] PATH_INFO: `/v3/projects/b5dbddcd69094af88d287ce59e444db4/users/a773d12f4b9a495e8a53c782182d25c3/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.598880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8d0b0fab0d547f3bfdb75c33a31ffb6, user_id=bb571277f28d489884499cb297276547, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.603299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.605620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dbddcd69094af88d287ce59e444db4, user_id=a773d12f4b9a495e8a53c782182d25c3, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.609635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763372ac-ba9f-4e23-8ec5-f8f40750bacd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.643631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 856/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:23 2022] PUT /identity/v3/projects/c8d0b0fab0d547f3bfdb75c33a31ffb6/users/bb571277f28d489884499cb297276547/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:23.643631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.648325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 861/1717] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:23 2022] PUT /identity/v3/projects/b5dbddcd69094af88d287ce59e444db4/users/a773d12f4b9a495e8a53c782182d25c3/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:23.650210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47b3f-be75-4785-846b-100950f68267 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.650667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47b3f-be75-4785-846b-100950f68267 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.651121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e47b3f-be75-4785-846b-100950f68267 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.721061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-34e47b3f-be75-4785-846b-100950f68267 None None] MFA Rules not processed for user `bb571277f28d489884499cb297276547`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:23.721061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-34e47b3f-be75-4785-846b-100950f68267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:23.739583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:23.747691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3af8fd-310a-481d-96e5-f5b249672fef admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.817795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.818671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.819057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.819401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.823345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:23.831633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.833503 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:23.839762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 862/1718] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:23.839762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47b3f-be75-4785-846b-100950f68267 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.848128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 857/1719] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:23.849267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:23.979840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d552987d-b65e-4063-94f6-4a408b65af01 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:23.985556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:23.986192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:23.986476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:23.986749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:23.987399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:23.989403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dab6456-3f30-4962-931d-b8e83066a208 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:24.047030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 858/1720] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:23 2022] POST /identity/v3/projects => generated 361 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:24.047030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.047030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.047030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.068750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e47b3f-be75-4785-846b-100950f68267 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:24.089573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] MFA Rules not processed for user `65341da46cb04d5b898687920dcafc80`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:24.091043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:24.271409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:24.274461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.274681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.274956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.275620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:24.286748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 859/1721] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:24.286748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:24.287327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:24.341706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25668da-9958-4a7a-8093-e757e197a43d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:24.341939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 863/1722] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:23 2022] GET /identity/v3/roles => generated 1420 bytes in 505 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:24.346387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:24.369919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:24.370655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.371016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.371292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.371978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:24.382263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a930e04-4f81-4f11-8566-7b609076018e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:24.394260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:24.398806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:24.399507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.399804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.400075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] PATH_INFO: `/v3/projects/b5dbddcd69094af88d287ce59e444db4/users/a773d12f4b9a495e8a53c782182d25c3/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.408048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5dbddcd69094af88d287ce59e444db4, user_id=a773d12f4b9a495e8a53c782182d25c3, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:24.420303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22f9beee-6722-445c-bf5c-b5a60d50a883 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:24.461088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 864/1723] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:24 2022] PUT /identity/v3/projects/b5dbddcd69094af88d287ce59e444db4/users/a773d12f4b9a495e8a53c782182d25c3/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:24.471939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.472927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.473703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.476446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 860/1724] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:24 2022] POST /identity/v3/users => generated 287 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:24.477443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:24.483308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:24.496271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af39374-26f7-4b93-a026-5638cd0e8ccb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:24.585814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] MFA Rules not processed for user `a773d12f4b9a495e8a53c782182d25c3`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:24.587255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:24.651962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:24.652601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:24.652876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:24.653667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:24.654326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:24.667894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:24.722856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 861/1725] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:24 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:24.736123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:24.738209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:24.972525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 865/1726] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:24 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 502 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:24.978330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:25.009125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78614e6-aff5-4e62-9692-b7e6c02252c9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.023131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.024114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.024671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.025172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] PATH_INFO: `/v3/projects/e1bda725157946aa87f6383fca0c16ce/users/098ec73c5b3c4af1a74b4618451b0d7f/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.044741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:25.060825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bda725157946aa87f6383fca0c16ce, user_id=098ec73c5b3c4af1a74b4618451b0d7f, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.071859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:25.084089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ba042e-2194-40d8-bcd7-a5c4549b2c29 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.095575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 866/1727] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:24 2022] PUT /identity/v3/projects/e1bda725157946aa87f6383fca0c16ce/users/098ec73c5b3c4af1a74b4618451b0d7f/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:25.098556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:25.102003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:25.329054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.330333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.330973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.334043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.346805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85dcc22-576d-4229-ae0a-ed777f522c19 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.365366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.368687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.368977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.369257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.401307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:25.415671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:25.437308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.438919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:25.506707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.509022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:25.512616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 867/1728] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:25.513670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:25.559781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 862/1729] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:24 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 836 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:25.561232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:25.658709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2303-d50f-4601-9fd2-31378ac9834b service placement] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.669084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.669932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.670361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.671607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.827853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a0901-810c-40a4-96e5-cefb3d763b45 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.847312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.848058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.848247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.848518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.849236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.851423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189fdd1f-262d-4f25-bdfd-a52ee33231e1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:25.882118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 863/1730] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:25 2022] GET /identity/v3/roles => generated 1420 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:25.885695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1a5b-68cb-437a-a104-0dbb218ba7f0 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.886014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1a5b-68cb-437a-a104-0dbb218ba7f0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.886296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0d1a5b-68cb-437a-a104-0dbb218ba7f0 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.894935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 864/1731] 10.222.0.42 () {54 vars in 961 bytes} [Tue Sep 20 04:52:25 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:25.901213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec35b-70a5-42d4-9962-ef310d45f619 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.901415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec35b-70a5-42d4-9962-ef310d45f619 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.901689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ec35b-70a5-42d4-9962-ef310d45f619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.902308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.906850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:25.935125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1d6ec35b-70a5-42d4-9962-ef310d45f619 None None] MFA Rules not processed for user `c06f8365a64b4a0cbd22bc9c4b3da595`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:25.936914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1d6ec35b-70a5-42d4-9962-ef310d45f619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:25.939596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 868/1732] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:25 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:25.941122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:25.977791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10557082-5c8c-47f5-814e-eea9e1e472b3 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:25.985032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:25.986456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:25.986960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:25.987424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] PATH_INFO: `/v3/projects/e1bda725157946aa87f6383fca0c16ce/users/098ec73c5b3c4af1a74b4618451b0d7f/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:25.990557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1bda725157946aa87f6383fca0c16ce, user_id=098ec73c5b3c4af1a74b4618451b0d7f, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:25.994643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf51f21-f90e-43c6-b4f1-9d567f4d620d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:26.032290 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 869/1733] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:25 2022] PUT /identity/v3/projects/e1bda725157946aa87f6383fca0c16ce/users/098ec73c5b3c4af1a74b4618451b0d7f/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:26.034053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054a7f2-5c2b-43da-ad06-4d879ecae070 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:26.034914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054a7f2-5c2b-43da-ad06-4d879ecae070 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:26.035289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1054a7f2-5c2b-43da-ad06-4d879ecae070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:26.071450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1054a7f2-5c2b-43da-ad06-4d879ecae070 None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:26.072825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1054a7f2-5c2b-43da-ad06-4d879ecae070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:26.083371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:26.095838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 865/1734] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:25 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:26.101537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:26.102983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:26.103557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:26.189258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] MFA Rules not processed for user `c32d9ea3c6a44d15b2b050e99524b56e`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:26.195196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:26.220883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 870/1735] 10.222.0.42 () {58 vars in 1058 bytes} [Tue Sep 20 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:26.227382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:26.229338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:26.231498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:26.348514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] MFA Rules not processed for user `098ec73c5b3c4af1a74b4618451b0d7f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:26.358132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:26.471353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 866/1736] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 373 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:26.472397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:26.504468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:26.527266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34a606a-1a7d-4ad9-a361-8b65dde82cc8 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:26.547340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:26.552243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:26.552547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:26.553955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:26.588525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:26.600466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:26.624115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 871/1737] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:26 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 399 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:26.655037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 867/1738] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:26.833094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:26.840803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:26.895813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:27.145990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f96166-55dc-4195-ba0c-2115d2b81854 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:27.160683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:27.165270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:27.165622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:27.167461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:27.207593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:27.210253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:27.218211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf83ba-fce6-4e84-9e0c-a48acc69b6fe service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:27.232702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:27.237295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:27.237633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:27.240007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:27.256033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 872/1739] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:27.260836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:27.289376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:27.303204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:27.338322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 868/1740] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:27.461627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:27.553994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20533438-7844-4a62-b0ca-e230bfde0d7a service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:27.571763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773d12f4b9a495e8a53c782182d25c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dbddcd69094af88d287ce59e444db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:27.572691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:27.572977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:27.573248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:27.573911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:27.574213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:27.575909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:27.632004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 873/1741] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:27.636175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:27.672535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10379ab-afa9-42bf-bfa7-45d60bf90018 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:27.709919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773d12f4b9a495e8a53c782182d25c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dbddcd69094af88d287ce59e444db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:27.711203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:27.713500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:27.713884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:27.714855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:27.725479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:27.877014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:27.877200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 869/1742] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:27 2022] POST /identity/v3/projects => generated 355 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:27.890035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6ff22e-d7a9-4f6c-8088-d63f672b56ed tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:28.096477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773d12f4b9a495e8a53c782182d25c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dbddcd69094af88d287ce59e444db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:28.097218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:28.097497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:28.097768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:28.098417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:28.104222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:28.105947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:28.151498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 874/1743] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:52:28.362372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:28.384397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14cf0d3-6d6a-4ff9-ac08-617af7991588 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:28.407234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a773d12f4b9a495e8a53c782182d25c3', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'b5dbddcd69094af88d287ce59e444db4', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:28.409559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:28.411278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:28.412448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] PATH_INFO: `/v3/projects/11acf68148704c68aa6c19ad4dad5740` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:28.417044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorizing `identity:delete_project(project_id=11acf68148704c68aa6c19ad4dad5740)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:28.424641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:28.592805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11acf68148704c68aa6c19ad4dad5740', 'request_id': 'req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:28.619688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11acf68148704c68aa6c19ad4dad5740', 'request_id': 'req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:28.643107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11acf68148704c68aa6c19ad4dad5740', 'request_id': 'req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:28.675896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] The token cache is being invalidate because project 11acf68148704c68aa6c19ad4dad5740 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:28.676308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:28.677483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:28.684478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 870/1744] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:28 2022] DELETE /identity/v3/projects/11acf68148704c68aa6c19ad4dad5740 => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:29.586328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:29.588638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:29.610312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:29.611784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:29.915779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:29.973084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56cdcad-e3b2-41df-bde9-72c5d8c440c7 tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:30.059162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9ee008-23dc-447b-ad08-c691bc3ee5ef tempest-VolumeQuotaClassesTest-1979253109 tempest-VolumeQuotaClassesTest-1979253109-project-admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:30.092543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:30.093431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.093716 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.093990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] PATH_INFO: `/v3/users/acf6de96d5ab4426a9fbd1f1d13400e1` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.097962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=acf6de96d5ab4426a9fbd1f1d13400e1)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:30.102906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:30.261940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:30.262613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.264940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.265226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] PATH_INFO: `/v3/users/bb571277f28d489884499cb297276547` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.275024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb571277f28d489884499cb297276547)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:30.279158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:30.306450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acf6de96d5ab4426a9fbd1f1d13400e1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.308102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acf6de96d5ab4426a9fbd1f1d13400e1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.308942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acf6de96d5ab4426a9fbd1f1d13400e1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.313541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:30.341368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acf6de96d5ab4426a9fbd1f1d13400e1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.354910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-79c6d475-47a0-46cf-864d-1dc05477c7ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acf6de96d5ab4426a9fbd1f1d13400e1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.380680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 871/1745] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:29 2022] DELETE /identity/v3/users/acf6de96d5ab4426a9fbd1f1d13400e1 => generated 0 bytes in 771 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:30.386003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.386996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.387891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.388499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb571277f28d489884499cb297276547'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.390986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb571277f28d489884499cb297276547'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.391879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb571277f28d489884499cb297276547'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.404827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb571277f28d489884499cb297276547'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.426759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:30.427405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2fc0cfc2-b2d0-490c-aa47-3d128bab9f83 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb571277f28d489884499cb297276547'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:30.429342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:30.455357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 875/1746] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:29 2022] DELETE /identity/v3/users/bb571277f28d489884499cb297276547 => generated 0 bytes in 869 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:30.460824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.461113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.461382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.491891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:30.493420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:30.551885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 872/1747] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:30.563450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:30.566217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:30.586969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 876/1748] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:30.598814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:30.600909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:30.662650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20345799-c18f-4978-81ad-bfa935352db6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:30.690358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:30.744907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2517fb8-505e-458a-86a2-b199af684f45 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:30.755368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:30.758382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.758895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.759398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.786551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:30.787176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.787588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.787988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.804794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:30.806988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e775c1a4-7114-4f44-9c59-1f7b9b55a47e service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:30.838921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 877/1749] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:30.843240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:30.852449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:30.887440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae6ed-daa1-4458-949e-c5bb01ed4fed None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:30.888421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae6ed-daa1-4458-949e-c5bb01ed4fed None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:30.888763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caae6ed-daa1-4458-949e-c5bb01ed4fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:30.901591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 873/1750] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:30.984696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7caae6ed-daa1-4458-949e-c5bb01ed4fed None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:30.988467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7caae6ed-daa1-4458-949e-c5bb01ed4fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:31.027919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:31.144856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 878/1751] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:52:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:31.474017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:31.476214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:31.768168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae1d593-bed6-4899-9f02-e961798277a3 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:31.783999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:31.787288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:31.788436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:31.788960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:31.804301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:31.807165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:31.819551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 874/1752] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 04:52:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 04:52:32.928543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:32.929959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:32.930292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:32.992811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] MFA Rules not processed for user `65341da46cb04d5b898687920dcafc80`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:33.000397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:33.133835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 879/1753] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:32 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:33.427169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:33.428947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:33.454159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66834fd2-e9b2-4b61-bbd9-1ee71618e984 service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:33.467466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:33.468195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:33.468481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:33.468758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] PATH_INFO: `/v3/projects/c8d0b0fab0d547f3bfdb75c33a31ffb6` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:33.469934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8d0b0fab0d547f3bfdb75c33a31ffb6)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:33.472013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:33.585186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8d0b0fab0d547f3bfdb75c33a31ffb6', 'request_id': 'req-203f0cd1-6356-4b18-b677-74bac32dea59'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.600456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8d0b0fab0d547f3bfdb75c33a31ffb6', 'request_id': 'req-203f0cd1-6356-4b18-b677-74bac32dea59'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.605216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:33.607254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:33.617346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8d0b0fab0d547f3bfdb75c33a31ffb6', 'request_id': 'req-203f0cd1-6356-4b18-b677-74bac32dea59'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.645709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feac49d9-a9d4-4d6b-a81e-614383125fb0 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:33.649936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] The token cache is being invalidate because project c8d0b0fab0d547f3bfdb75c33a31ffb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:33.650284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.660955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.668264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 875/1754] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:33 2022] DELETE /identity/v3/projects/c8d0b0fab0d547f3bfdb75c33a31ffb6 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:33.671314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:33.675263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:33.713726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:33.833897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:33.837248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:33.837763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:33.838050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] PATH_INFO: `/v3/users/0a0a27668b61403fb80d9570dfab8f2e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:33.842780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a0a27668b61403fb80d9570dfab8f2e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:33.845121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:33.924530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203f0cd1-6356-4b18-b677-74bac32dea59 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:33.977372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:33.978134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:33.978396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:33.978684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] PATH_INFO: `/v3/users/098ec73c5b3c4af1a74b4618451b0d7f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:33.980012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] RBAC: Authorizing `identity:delete_user(user_id=098ec73c5b3c4af1a74b4618451b0d7f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:33.982102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:33.983923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a0a27668b61403fb80d9570dfab8f2e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.984661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a0a27668b61403fb80d9570dfab8f2e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:33.985518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a0a27668b61403fb80d9570dfab8f2e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.009066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:34.016476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a0a27668b61403fb80d9570dfab8f2e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.063751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-aa1e3fa9-fa0e-462d-93c0-a93e62a68a66 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a0a27668b61403fb80d9570dfab8f2e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.105461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 880/1755] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:33 2022] DELETE /identity/v3/users/0a0a27668b61403fb80d9570dfab8f2e => generated 0 bytes in 501 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:34.109889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:34.110658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:34.111105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:34.120012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098ec73c5b3c4af1a74b4618451b0d7f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.123206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098ec73c5b3c4af1a74b4618451b0d7f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.123904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098ec73c5b3c4af1a74b4618451b0d7f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.173551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:34.180337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:34.196092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098ec73c5b3c4af1a74b4618451b0d7f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.249721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098ec73c5b3c4af1a74b4618451b0d7f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:34.293320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 876/1756] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:33 2022] DELETE /identity/v3/users/098ec73c5b3c4af1a74b4618451b0d7f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:34.395772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 881/1757] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 287 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:34.494371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:34.494371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:34.659177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba4722-11ae-47c3-abbf-cd057f71f758 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:34.669188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:34.671002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:34.671499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:34.672042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:34.750519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:34.831721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:34.836281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:34.868906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 877/1758] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:34.917996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:34.919510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:34.946210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3390ff03-4bd5-4a9f-97fe-8c08eb297edd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:34.960259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:34.965774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:34.966234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:34.967047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] PATH_INFO: `/v3/projects/ac3615bb5b224027a8a611096582ae7e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:34.972757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ac3615bb5b224027a8a611096582ae7e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:34.977954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:35.125243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ac3615bb5b224027a8a611096582ae7e', 'request_id': 'req-13756939-aabb-4007-8f64-95868c5639f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.148913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ac3615bb5b224027a8a611096582ae7e', 'request_id': 'req-13756939-aabb-4007-8f64-95868c5639f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.170638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ac3615bb5b224027a8a611096582ae7e', 'request_id': 'req-13756939-aabb-4007-8f64-95868c5639f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.188822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] The token cache is being invalidate because project ac3615bb5b224027a8a611096582ae7e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:35.199749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.201025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-13756939-aabb-4007-8f64-95868c5639f9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.204105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 882/1759] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:34 2022] DELETE /identity/v3/projects/ac3615bb5b224027a8a611096582ae7e => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:35.207911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:35.224701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446989d0-16e4-4f4f-becd-65481c08699b service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:35.392766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:35.394066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:35.394441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:35.394830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] PATH_INFO: `/v3/users/a773d12f4b9a495e8a53c782182d25c3` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:35.396374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a773d12f4b9a495e8a53c782182d25c3)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:35.399177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:35.549344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a773d12f4b9a495e8a53c782182d25c3'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.552392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a773d12f4b9a495e8a53c782182d25c3'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.556898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a773d12f4b9a495e8a53c782182d25c3'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.583969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a773d12f4b9a495e8a53c782182d25c3'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.593268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a773d12f4b9a495e8a53c782182d25c3'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:35.648874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 878/1760] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:35 2022] DELETE /identity/v3/users/a773d12f4b9a495e8a53c782182d25c3 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:35.701001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:35.701542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:35.701915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:35.744820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:35.748699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:35.892663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:35.894822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:35.918384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 883/1761] 10.222.0.26 () {58 vars in 1015 bytes} [Tue Sep 20 04:52:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:35.955007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:35.959300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:35.970590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:35.981033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa36834-f94d-46fa-b090-5339949f0878 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:35.997743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:35.998731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:35.999172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:35.999939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.011332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:36.013162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:36.038423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 884/1762] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:36.039555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:36.041359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:36.071553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:36.080668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b45f79-99b5-4708-9f59-171d75bce9a3 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:36.085130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af725a3a-cea6-4b98-8bcf-39a6a8d94256 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:36.093937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:36.095558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.095868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.096159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] PATH_INFO: `/v3/projects/e1bda725157946aa87f6383fca0c16ce` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.101031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1bda725157946aa87f6383fca0c16ce)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:36.105401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:36.106271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.106772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.108356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] PATH_INFO: `/v3/projects/e413abd2059d4108a98f6c47af276f9e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.109771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e413abd2059d4108a98f6c47af276f9e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:36.110099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:36.112189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:36.268172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1bda725157946aa87f6383fca0c16ce', 'request_id': 'req-faf10e45-39aa-469a-bbbd-c396335d6893'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.272976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e413abd2059d4108a98f6c47af276f9e', 'request_id': 'req-73b3482a-f92c-4429-9171-4f27edac6548'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.287003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e413abd2059d4108a98f6c47af276f9e', 'request_id': 'req-73b3482a-f92c-4429-9171-4f27edac6548'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.289530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1bda725157946aa87f6383fca0c16ce', 'request_id': 'req-faf10e45-39aa-469a-bbbd-c396335d6893'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.308534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e413abd2059d4108a98f6c47af276f9e', 'request_id': 'req-73b3482a-f92c-4429-9171-4f27edac6548'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.312203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1bda725157946aa87f6383fca0c16ce', 'request_id': 'req-faf10e45-39aa-469a-bbbd-c396335d6893'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.337840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] The token cache is being invalidate because project e413abd2059d4108a98f6c47af276f9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:36.339211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.342471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.346832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 885/1763] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:36 2022] DELETE /identity/v3/projects/e413abd2059d4108a98f6c47af276f9e => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:36.351673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:36.352597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] The token cache is being invalidate because project e1bda725157946aa87f6383fca0c16ce was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:36.352879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.356428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-faf10e45-39aa-469a-bbbd-c396335d6893 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.356701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:36.367466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 879/1764] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:35 2022] DELETE /identity/v3/projects/e1bda725157946aa87f6383fca0c16ce => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:36.369027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306237-814e-4d67-96d2-b0ff3bd286f0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.369316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306237-814e-4d67-96d2-b0ff3bd286f0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.369623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04306237-814e-4d67-96d2-b0ff3bd286f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.444075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-04306237-814e-4d67-96d2-b0ff3bd286f0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:36.454167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-04306237-814e-4d67-96d2-b0ff3bd286f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:36.526114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b3482a-f92c-4429-9171-4f27edac6548 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:36.537683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:36.538351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.538618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.543304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] PATH_INFO: `/v3/users/87a256b6dd62463697644a03eea38423` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.544974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=87a256b6dd62463697644a03eea38423)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:36.550961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:36.683217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '87a256b6dd62463697644a03eea38423'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.687534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '87a256b6dd62463697644a03eea38423'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.689325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 880/1765] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:36.690237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '87a256b6dd62463697644a03eea38423'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.690786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.691140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.691421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.715418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '87a256b6dd62463697644a03eea38423'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.751815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-17e46c6f-5777-44ad-841c-eefb081933b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '87a256b6dd62463697644a03eea38423'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:36.757450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:36.767833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:36.769229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:36.795109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 886/1766] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:36 2022] DELETE /identity/v3/users/87a256b6dd62463697644a03eea38423 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:36.797658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:36.797658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:36.797658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:36.815993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 881/1767] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:36.827246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:36.856128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f542e9-dee1-4526-bce5-33572fa0a8d7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:36.860523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] MFA Rules not processed for user `c32d9ea3c6a44d15b2b050e99524b56e`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:36.862736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:37.122858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 887/1768] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:36 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:37.133246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.134051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.134485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.134911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.135925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:37.136376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.138152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:37.194653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 882/1769] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 364 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:37.197932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:37.231101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a6d66c-a114-4d4c-b198-235c8076ec0e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:37.262298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.264758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.267120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.267771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.270925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.306159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:37.417320 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 888/1770] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:37 2022] POST /identity/v3/projects => generated 387 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:37.418899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:37.437116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660d2271-8a05-4e41-9000-b54f881b9fff admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:37.457054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:37.574958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.576901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.577359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.580122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.582612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.595287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:37.673839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 883/1771] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:37 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:37.675929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:37.696488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74463b43-1cd7-49f9-b975-0d7bfa19dbbc admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:37.716566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.717233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.720061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.720399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.721087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.722729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:37.766371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 889/1772] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:37.768283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:37.781981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e6a0b6-c5e8-4841-bae8-be3a98f77377 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:37.802380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.804050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.804397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.804886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.805567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.807821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432dd71e-82df-4abe-b292-27fe3f31cd24 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:37.869337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 884/1773] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:37 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:37.870855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:37.904114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ada1862-ba29-4707-86f0-0eee39f8bed5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:37.916979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:37.918123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:37.918690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:37.919330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] PATH_INFO: `/v3/projects/304437c19be840a0b041ed59ea43a9f9/users/cbc94f0d30194e1f97f6fe8211b9b8d1/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:37.990901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=304437c19be840a0b041ed59ea43a9f9, user_id=cbc94f0d30194e1f97f6fe8211b9b8d1, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:37.993795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:38.033172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 890/1774] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:37 2022] PUT /identity/v3/projects/304437c19be840a0b041ed59ea43a9f9/users/cbc94f0d30194e1f97f6fe8211b9b8d1/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:38.046339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:38.046631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:38.046998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:38.141911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] MFA Rules not processed for user `cbc94f0d30194e1f97f6fe8211b9b8d1`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:38.146058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:38.386383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 885/1775] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:38 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:38.390759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:38.572402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccadf4c1-dda0-49c0-b991-e3ea6eeda4ad admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:38.580044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:38.581127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:38.581616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:38.582265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:38.583219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:38.585707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:38.637713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 891/1776] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:38 2022] POST /identity/v3/projects => generated 387 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:38.641320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:38.659303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc596eb-39f6-4eb6-97c6-f61830cd57f0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:38.817978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:38.818860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:38.818953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:38.819236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:38.820145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:38.822392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:38.885444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 886/1777] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:38 2022] POST /identity/v3/users => generated 300 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:38.889621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:38.909565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e24dba0-441d-4a39-8021-375ac70f778d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:38.916383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:38.920577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:38.920994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:38.921383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:38.924809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:38.926642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:38.960140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:38.960303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 892/1778] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:38 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:38.977844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c23c70-451b-4e5c-be34-2a5e28023e7b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:38.999709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:39.003686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.004014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.004291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] PATH_INFO: `/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a/users/a5a97c9e895448b7955417ed8225f4b5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.043824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:39.060687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc36e2425fe745b2974ab9fe7e06dd9a, user_id=a5a97c9e895448b7955417ed8225f4b5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:39.067278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:39.112996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 887/1779] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:38 2022] PUT /identity/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a/users/a5a97c9e895448b7955417ed8225f4b5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:39.118595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:39.141159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8d66bf-da6b-4d0d-9b36-ed59b3ae5afe admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:39.172921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:39.345058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:39.345779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.346272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.346744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.347570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:39.357678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:39.387076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 893/1780] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:39 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:39.388168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:39.410214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c247cd5-7acc-4321-993a-4cc82c967459 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:39.417344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:39.419850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:39.423840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:39.424518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.424799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.425117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] PATH_INFO: `/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a/users/a5a97c9e895448b7955417ed8225f4b5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.441976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86343133-d317-4bf9-b3a9-ebced07e2c83 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:39.447865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:39.448812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.449310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.449848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc36e2425fe745b2974ab9fe7e06dd9a, user_id=a5a97c9e895448b7955417ed8225f4b5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:39.450075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] PATH_INFO: `/v3/projects/b5dbddcd69094af88d287ce59e444db4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.451590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5dbddcd69094af88d287ce59e444db4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:39.454735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:39.463586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef20fb7-9cc7-4021-b603-644a5d65080c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:39.512634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 888/1781] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:39 2022] PUT /identity/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a/users/a5a97c9e895448b7955417ed8225f4b5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:39.523305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.524401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.525974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.546416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5dbddcd69094af88d287ce59e444db4', 'request_id': 'req-46be2b38-8e1b-414b-bca3-515ccdca9efe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:39.585268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5dbddcd69094af88d287ce59e444db4', 'request_id': 'req-46be2b38-8e1b-414b-bca3-515ccdca9efe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:39.611684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5dbddcd69094af88d287ce59e444db4', 'request_id': 'req-46be2b38-8e1b-414b-bca3-515ccdca9efe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:39.633483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] MFA Rules not processed for user `a5a97c9e895448b7955417ed8225f4b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:39.641882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:39.678935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] The token cache is being invalidate because project b5dbddcd69094af88d287ce59e444db4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:39.679291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:39.681756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-46be2b38-8e1b-414b-bca3-515ccdca9efe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:39.685147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 894/1782] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:39 2022] DELETE /identity/v3/projects/b5dbddcd69094af88d287ce59e444db4 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:39.707882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:39.708213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:39.708493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:39.777603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:39.778892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:39.937901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 889/1783] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:39 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:39.937901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:39.945067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.001181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 895/1784] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:40.002781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:40.009953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.106642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea19b5a-757e-45fc-b401-af3fde671895 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:40.134535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:40.135197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.135476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.135762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] PATH_INFO: `/v3/projects/c106b7132098488eb44104106c987616` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.139832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:40.142040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c106b7132098488eb44104106c987616)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:40.144933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:40.205345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd401a3d-1b95-4ece-9d7f-6a51e3960b1f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:40.226462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:40.227413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.227949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.228415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.245360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:40.262562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db0b74f-5b72-4180-ad0b-c10ec9143900 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:40.281924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 896/1785] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:40 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 280 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:40.283477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.283958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.284183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.300218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c106b7132098488eb44104106c987616', 'request_id': 'req-e7bd2629-6425-49da-aace-7ca2337a071a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.317918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c106b7132098488eb44104106c987616', 'request_id': 'req-e7bd2629-6425-49da-aace-7ca2337a071a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.334420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c106b7132098488eb44104106c987616', 'request_id': 'req-e7bd2629-6425-49da-aace-7ca2337a071a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.336620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:40.372561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] The token cache is being invalidate because project c106b7132098488eb44104106c987616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:40.372858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.373950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e7bd2629-6425-49da-aace-7ca2337a071a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.376578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 890/1786] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:39 2022] DELETE /identity/v3/projects/c106b7132098488eb44104106c987616 => generated 0 bytes in 438 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:40.383344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.384116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.384409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.419104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:40.427201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.453763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:40.457751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.670544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 897/1787] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:40.670544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:40.672308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.697341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f3a1d7-bdad-4929-9a41-2c3cdf1d511e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:40.708422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:40.711224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.712822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.715960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] PATH_INFO: `/v3/users/cbc94f0d30194e1f97f6fe8211b9b8d1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.717540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbc94f0d30194e1f97f6fe8211b9b8d1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:40.720016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:40.747964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 891/1788] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:40.752058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:40.792267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd761d2f-0d43-4260-9e8c-e3454f37b0d5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:40.802517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:40.803851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.804143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.804782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.805981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:40.809192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:40.812862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57b55f4b-689e-481e-8e77-014b99caa03a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:40.868299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbc94f0d30194e1f97f6fe8211b9b8d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.869469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbc94f0d30194e1f97f6fe8211b9b8d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.870092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 892/1789] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:40.871333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.871624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.871923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.872675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbc94f0d30194e1f97f6fe8211b9b8d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.900441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbc94f0d30194e1f97f6fe8211b9b8d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.940997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:40.942395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.948441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d94fd553-ff6d-4acc-956d-cd098229f9ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbc94f0d30194e1f97f6fe8211b9b8d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:40.981243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 898/1790] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:40 2022] DELETE /identity/v3/users/cbc94f0d30194e1f97f6fe8211b9b8d1 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:40.981243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bd9d8-a524-497d-8368-aebc30177353 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.981243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bd9d8-a524-497d-8368-aebc30177353 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.981243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546bd9d8-a524-497d-8368-aebc30177353 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:40.981746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 893/1791] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:40.982365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:40.985084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:40.987888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 899/1792] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:52:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:40.989687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:40.990000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:40.990276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.003940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16543df6-b3c1-41c6-aede-530beff65a50 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:41.024869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:41.026214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:41.127498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:41.170771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 900/1793] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:41.175580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:41.176654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:41.176938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:41.177215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.180448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:41.182542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:41.186390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:41.210755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd76d877-d952-44ea-a9ff-ee9033cb0586 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:41.225675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:41.226467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:41.226850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:41.227229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.228072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:41.228522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:41.231652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ce6f81-3e1c-44c3-8911-a9c5c7a19dd6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:41.257197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 901/1794] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:41.260121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:41.287877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:41.287877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.288329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 894/1795] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:40 2022] POST /identity/v3/projects => generated 393 bytes in 305 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:41.291334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:41.320807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:41.323118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:41.572140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 902/1796] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:52:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:41.574080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:41.629302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:41.653658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249d8ebf-a867-47c6-bda0-a8188a158137 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:41.667570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:41.669764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:41.670016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:41.670429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.673189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:41.679345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:41.818184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8a4390-8b3a-45ff-ba40-4c5304eafd7f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:41.847899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:41.848910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:41.853194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 895/1797] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:41 2022] POST /identity/v3/projects => generated 363 bytes in 562 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:41.853194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:41.860567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:41.861258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:41.861370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:41.862330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:41.866002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:41.911680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 903/1798] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:41 2022] POST /identity/v3/users => generated 297 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:41.916768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:41.941968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff415cdb-2610-4d29-a8d1-1fdbcd2a64e6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.094749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd06d5-9266-4f7b-bb6a-0ae2a77f4a40 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.105246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.109311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.109972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.110313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.110618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.111381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.113490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.115018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.116659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.117776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.138267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.138560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.152323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:42.165461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 896/1799] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:42.175781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.190165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7cd898-ba5d-4b1a-a678-0380e77639cd service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.196610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 904/1800] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:41 2022] POST /identity/v3/users => generated 282 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:42.197974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.222375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.223262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.223841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.224877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.226263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.234206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.251097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-457cdca1-bd22-4fbc-92f5-2dc736082ec9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.269797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.272786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.273031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.273296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.273963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.274172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 897/1801] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:42.276160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.293890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.307055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e698e2-af79-41b9-8b68-85e0b9ecfab8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.320495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.321263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.325450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.325854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.326737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.329140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.336716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 905/1802] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:42.342814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.374312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7705d05a-eb8a-4344-bc5a-deee2f274d84 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.381332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 898/1803] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:42.388327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.389220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.389689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.390853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.390965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.391763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.402519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.423014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 906/1804] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:42 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:42.430119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.456286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df60af0-850d-47b1-b169-e6a210617cce admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.463309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d934bb0f-c5dc-4a9a-83c0-fa22dbfb0df7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.471276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.473866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.474181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.475036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] PATH_INFO: `/v3/projects/c64c13105d90473c852f2bec2a97bc55/users/39fb0f0c200b467c9a5a8521913ac797/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.483046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.484174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.487112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.487414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] PATH_INFO: `/v3/projects/7e3a1cac927f40eab5aa9c4799ab1dd7/users/b85e4cf98eeb4c2fa138184cabb4861b/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.534083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c64c13105d90473c852f2bec2a97bc55, user_id=39fb0f0c200b467c9a5a8521913ac797, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.537608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e3a1cac927f40eab5aa9c4799ab1dd7, user_id=b85e4cf98eeb4c2fa138184cabb4861b, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.539912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.541439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15efa98b-7565-49fd-aa14-69b287293107 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.566710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 907/1805] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:42 2022] PUT /identity/v3/projects/c64c13105d90473c852f2bec2a97bc55/users/39fb0f0c200b467c9a5a8521913ac797/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:42.567897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:42.579719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 899/1806] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:42 2022] PUT /identity/v3/projects/7e3a1cac927f40eab5aa9c4799ab1dd7/users/b85e4cf98eeb4c2fa138184cabb4861b/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:42.580298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:42.581134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41c39-3863-499d-b26a-a1512735cc7e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.581589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41c39-3863-499d-b26a-a1512735cc7e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.581831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd41c39-3863-499d-b26a-a1512735cc7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.660893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8bd41c39-3863-499d-b26a-a1512735cc7e None None] MFA Rules not processed for user `39fb0f0c200b467c9a5a8521913ac797`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:42.662454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8bd41c39-3863-499d-b26a-a1512735cc7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:42.758120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b715f15b-121b-4f29-8aaa-2da5bdff81d3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:42.765310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:42.766680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.767624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.768123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.783184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:42.788832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:42.839768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 900/1807] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 259 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:42.842789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:42.847319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:42.847319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:42.862969 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 908/1808] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:42 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 281 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:42.864229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.010317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] MFA Rules not processed for user `b85e4cf98eeb4c2fa138184cabb4861b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:43.016955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:43.113876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c30c01-97c7-4c78-935d-11059e6cad13 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.128885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.130252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.131978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.133361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.136243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.146417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:43.164269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:43.241834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 909/1809] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:42 2022] POST /identity/v3/projects => generated 365 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:43.244382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.340980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:43.416023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 901/1810] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 576 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:43.421216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.481195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c5233e-9795-4901-991c-250825baf4a9 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.505025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d229c98b-f010-4ae8-b96d-f6ba3feb029c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.512547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.513260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.513878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.514056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.514889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.519501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:43.571987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 910/1811] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:43 2022] POST /identity/v3/users => generated 289 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:43.573161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.597021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66042e63-a704-43d3-a326-c1c5333e670b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.609490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.610559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.611058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.611427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.621039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.624015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:43.652244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 911/1812] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:43.653650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.680221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78972d15-cc95-4fac-884c-64caf8950eb6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.695870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.696555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.696876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.697228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] PATH_INFO: `/v3/projects/0a89ce7248ce4984914ceadaa23793de/users/59b082caa52e48d285d89b67a1bf86f4/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.731194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.731885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.732204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.732663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.733428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.738795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:43.763681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ce7248ce4984914ceadaa23793de, user_id=59b082caa52e48d285d89b67a1bf86f4, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.767589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:43.805570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 912/1813] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:43 2022] PUT /identity/v3/projects/0a89ce7248ce4984914ceadaa23793de/users/59b082caa52e48d285d89b67a1bf86f4/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:43.812016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.812764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 902/1814] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:43 2022] POST /identity/v3/projects => generated 391 bytes in 392 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:43.814852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:43.967646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae195180-38ca-496d-9502-bac61c25baef admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:43.986831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:43.988133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:43.988301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:43.988749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:43.990215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:43.992946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:44.012796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eda536b-df52-4df5-b1fa-c66554f7e5e2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.018826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.019462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.019814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.020298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.021995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:44.023800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e151329-9311-45cc-914f-e83f7209cf0c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:44.051352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 913/1815] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:43 2022] GET /identity/v3/roles => generated 1420 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:44.053477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966d3c-697d-4be6-9357-6e16b86d75bc None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.054271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966d3c-697d-4be6-9357-6e16b86d75bc None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.054558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8966d3c-697d-4be6-9357-6e16b86d75bc None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.060974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 914/1816] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:52:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:52:44.063559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966d3c-697d-4be6-9357-6e16b86d75bc None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:44.070625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 903/1817] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:43 2022] POST /identity/v3/users => generated 302 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:44.072226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:44.079678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8966d3c-697d-4be6-9357-6e16b86d75bc None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.086336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.087154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.087580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.087990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] PATH_INFO: `/v3/projects/0a89ce7248ce4984914ceadaa23793de/users/59b082caa52e48d285d89b67a1bf86f4/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.090232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a89ce7248ce4984914ceadaa23793de, user_id=59b082caa52e48d285d89b67a1bf86f4, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:44.094215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9714aff-bec6-4e47-8b65-8d670f834e8e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:44.118785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 915/1818] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:44 2022] PUT /identity/v3/projects/0a89ce7248ce4984914ceadaa23793de/users/59b082caa52e48d285d89b67a1bf86f4/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:44.118984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fadd83-6887-4fb5-9be8-20b5652c3555 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.121598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f974-a985-4080-859a-aecb480756ca None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.122109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f974-a985-4080-859a-aecb480756ca None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.122512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f349f974-a985-4080-859a-aecb480756ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.190404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:44.205304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f349f974-a985-4080-859a-aecb480756ca None None] MFA Rules not processed for user `59b082caa52e48d285d89b67a1bf86f4`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:44.206545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f349f974-a985-4080-859a-aecb480756ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:44.289740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.292010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.292676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.293576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.296762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:44.301830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff1d5e03-1f48-4082-860b-23c43670049e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:44.344132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 904/1819] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:44.348411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.348699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.348978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.368915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:44.410444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:44.411769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:44.451580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 916/1820] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 329 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:44.451580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349f974-a985-4080-859a-aecb480756ca None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:44.492404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f349f974-a985-4080-859a-aecb480756ca None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.503293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.504049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.504294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.504612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] PATH_INFO: `/v3/projects/513118e3b0244fdd9139abdd6d509975/users/9705212556c04067bb8ef9ed7242b7c5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.560748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] RBAC: Authorizing `identity:create_grant(project_id=513118e3b0244fdd9139abdd6d509975, user_id=9705212556c04067bb8ef9ed7242b7c5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:44.564273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:44.611422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 917/1821] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:44 2022] PUT /identity/v3/projects/513118e3b0244fdd9139abdd6d509975/users/9705212556c04067bb8ef9ed7242b7c5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:44.612454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:44.617017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:44.661195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 905/1822] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:52:44 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:44.663723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:44.709099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3820ae0-0ffc-442a-b73e-345d6763fb81 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.803895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb12b0e-0c19-46b3-af7e-a650eeecf10a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:44.816202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.818698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.819014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.821780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.971618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:44.972488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:44.972743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:44.972978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:44.973652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:44.999530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:45.055170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 906/1823] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:44 2022] GET /identity/v3/roles => generated 1420 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:45.061805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:45.118935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26628f95-7708-4a13-a883-4d20b7f2bf4b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:45.133540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:45.134589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:45.136342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:45.136776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:45.137201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] PATH_INFO: `/v3/projects/513118e3b0244fdd9139abdd6d509975/users/9705212556c04067bb8ef9ed7242b7c5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:45.137946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:45.142273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=513118e3b0244fdd9139abdd6d509975, user_id=9705212556c04067bb8ef9ed7242b7c5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:45.151239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b7fc0c-a509-4708-beae-dad959761b7e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:45.164859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 918/1824] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:44 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:45.166433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:45.168760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:45.191930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9adc9ade-3a00-43f4-9f8b-f628fd8e4b13 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:45.207012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 907/1825] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:45 2022] PUT /identity/v3/projects/513118e3b0244fdd9139abdd6d509975/users/9705212556c04067bb8ef9ed7242b7c5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:45.221617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:45.221894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:45.222304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:45.311154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] MFA Rules not processed for user `9705212556c04067bb8ef9ed7242b7c5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:45.312645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:45.493921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:45.563925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:45.578417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:45.580716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:45.581081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] PATH_INFO: `/v3/projects/304437c19be840a0b041ed59ea43a9f9` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:45.585058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=304437c19be840a0b041ed59ea43a9f9)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:45.589050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:45.610062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:45.629226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 908/1826] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:45 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 409 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:45.644317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:45.742857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '304437c19be840a0b041ed59ea43a9f9', 'request_id': 'req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:45.769577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94aea89-de66-4cee-a716-ab98c0533de1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:45.775040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '304437c19be840a0b041ed59ea43a9f9', 'request_id': 'req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:45.784264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '304437c19be840a0b041ed59ea43a9f9', 'request_id': 'req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:45.811176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] The token cache is being invalidate because project 304437c19be840a0b041ed59ea43a9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:45.811176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:45.812268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:45.814734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 919/1827] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:45 2022] DELETE /identity/v3/projects/304437c19be840a0b041ed59ea43a9f9 => generated 0 bytes in 649 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:45.815523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:45.817558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:45.915537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:45.916301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:45.916452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:45.916704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:45.921813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:45.961532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4df4def-dafd-43ce-82f6-8ac3ef6fb5fe admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:45.973260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:45.975471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:45.977287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:45.977668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:45.982765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:45.999096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.000619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.010988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 909/1828] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:45 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:46.011836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:46.013121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:46.078173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:46.088845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.090461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.102754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 920/1829] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:45 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 287 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:46.103855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:46.105720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:46.127173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc4724e-1dda-44ea-9420-45fc4bdbc5dc service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:46.136797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:46.137489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:46.137944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:46.138202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:46.141180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:46.155661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.159352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.173589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 910/1830] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:46.205207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:46.244077 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:46.253298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef5cfa6-e973-4fcd-801c-4824d067abcb service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:46.257889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad0537e-910d-4578-a304-fac6367874b8 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:46.260976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:46.261943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:46.262678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:46.263622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] PATH_INFO: `/v3/users/a5a97c9e895448b7955417ed8225f4b5` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:46.267152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5a97c9e895448b7955417ed8225f4b5)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.270882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:46.271061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:46.272095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:46.272379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:46.272886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.284293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:46.358981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5a97c9e895448b7955417ed8225f4b5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.360181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5a97c9e895448b7955417ed8225f4b5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.361033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5a97c9e895448b7955417ed8225f4b5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.373076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5a97c9e895448b7955417ed8225f4b5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.393114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5a97c9e895448b7955417ed8225f4b5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.396975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.399063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0816eb1-e892-42e7-9fac-9c589f25e31d service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.412036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 921/1831] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:46 2022] DELETE /identity/v3/users/a5a97c9e895448b7955417ed8225f4b5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:46.419142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 911/1832] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:46 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:46.725722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:46.727514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:46.823244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61975f73-79e1-4c29-83e3-8326ba4bfcc8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:46.835720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:46.836414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:46.836692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:46.836961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] PATH_INFO: `/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:46.838112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc36e2425fe745b2974ab9fe7e06dd9a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:46.840253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:46.904715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc36e2425fe745b2974ab9fe7e06dd9a', 'request_id': 'req-558c75da-e681-4278-b2fb-f36c1b6d930c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.916286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc36e2425fe745b2974ab9fe7e06dd9a', 'request_id': 'req-558c75da-e681-4278-b2fb-f36c1b6d930c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.932219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc36e2425fe745b2974ab9fe7e06dd9a', 'request_id': 'req-558c75da-e681-4278-b2fb-f36c1b6d930c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.935389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:46.950891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] The token cache is being invalidate because project fc36e2425fe745b2974ab9fe7e06dd9a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:46.951306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.952331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-558c75da-e681-4278-b2fb-f36c1b6d930c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:46.957899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 922/1833] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:46 2022] DELETE /identity/v3/projects/fc36e2425fe745b2974ab9fe7e06dd9a => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:46.959759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:46.960746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:46.961076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:46.981865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:46.983129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:47.054414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 912/1834] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:47.062263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.062549 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.062821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.082642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:47.083825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:47.092699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 923/1835] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:47.097591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.108072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b738c9c-67ef-4bc7-af3c-b8aafeb736bc None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.112614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.113466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.113466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.113756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.114404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:47.115393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.117148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.129447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 913/1836] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:47.134206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.144342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf665c4d-c6fc-41b4-929b-9ba913277306 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.148505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.149118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.149396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.149669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.150314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.152259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.184744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 924/1837] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:47.185936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.195852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf9a88d-48f3-4c35-8297-995ae9b5852f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.245551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:47.256642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.257241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.257524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.257794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.258427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.260664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.285424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 914/1838] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/users => generated 291 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:47.287148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.299355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74acab7b-c564-4e8a-86f8-776d15bbfdb2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.311994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.312838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.313186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.314922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.314922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.315941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.330504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 925/1839] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:47.334956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.346392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60883750-f691-419b-82c6-d8645aecf2d7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.352051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.352719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.353003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.353257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.353957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.355543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c981f3-ba27-4b1d-9895-62df24cd856c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.371805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 915/1840] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:52:47.374020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.385713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7b787d-6a90-4429-bc66-8d462b6afb57 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.393572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.394359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.394709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.395056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] PATH_INFO: `/v3/projects/4689bcc7738e402a88aa072d246690f3/users/1f34fc9e0d0442a79f5c7d884f4973a1/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.414689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4689bcc7738e402a88aa072d246690f3, user_id=1f34fc9e0d0442a79f5c7d884f4973a1, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.419368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.443823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 926/1841] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:47 2022] PUT /identity/v3/projects/4689bcc7738e402a88aa072d246690f3/users/1f34fc9e0d0442a79f5c7d884f4973a1/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:47.452609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.453402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.453785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.509119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] MFA Rules not processed for user `1f34fc9e0d0442a79f5c7d884f4973a1`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:47.510779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:47.628013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 916/1842] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:47.633930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.774521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a30f8d-4c07-4c23-8913-71a831e7a203 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:47.779305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:47.779959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:47.780236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:47.780509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:47.781146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:47.783641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:47.835040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:47.837250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 927/1843] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/projects => generated 381 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:47.854420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f004c9f-173d-49a5-baaa-99fad32915e2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.007549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.008390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.008680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.008947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.009584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.011491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.057164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 917/1844] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:47 2022] POST /identity/v3/users => generated 297 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:48.061652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.074248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079cfd03-afd7-4278-8d2c-0b7d83c09ef1 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.079652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.080532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.080816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.081085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.082027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.084307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.096160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 928/1845] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:48.100767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.112304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67aa4bda-f973-4b73-87a4-10834c29287e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.123168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.123915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.124192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.124462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] PATH_INFO: `/v3/projects/bf307949580e4b99bba0b86d920c0cd2/users/a9956aaede974f4492f7f11128e34fd1/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.160517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf307949580e4b99bba0b86d920c0cd2, user_id=a9956aaede974f4492f7f11128e34fd1, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.163931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.194311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 918/1846] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:48 2022] PUT /identity/v3/projects/bf307949580e4b99bba0b86d920c0cd2/users/a9956aaede974f4492f7f11128e34fd1/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:48.195685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.214464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac3c4fc-c054-412f-a072-c8bfe137b2e0 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.333512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.334553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.334940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.335349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.337025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.338564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470d8c90-8abd-4ebf-b686-5f9cceb6aa76 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.341378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:48.356223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 929/1847] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:48 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:48.358030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.378420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7ae4e-c8b5-47db-92dd-ef0d1f13d06e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.389843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.391885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.392505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.393003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] PATH_INFO: `/v3/projects/bf307949580e4b99bba0b86d920c0cd2/users/a9956aaede974f4492f7f11128e34fd1/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.397853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf307949580e4b99bba0b86d920c0cd2, user_id=a9956aaede974f4492f7f11128e34fd1, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.401072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.426681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 919/1848] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:48 2022] PUT /identity/v3/projects/bf307949580e4b99bba0b86d920c0cd2/users/a9956aaede974f4492f7f11128e34fd1/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:48.438999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.439408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.439796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.472598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] MFA Rules not processed for user `a9956aaede974f4492f7f11128e34fd1`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:48.474038 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:48.592116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 930/1849] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:48 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:48.650624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.652436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:48.669738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:48.741051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd25986-c605-45ea-aaaa-498d478a8346 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.746850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.748669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.750598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.750976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:48.764717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:48.766563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:48.776897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 920/1850] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:48.927799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:48.937301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09dd9628-fa91-41b4-a5f4-a620ceda25fd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:48.941251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:48.941826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:48.942161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:48.942434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:49.030532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:49.032208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d7b8e2-e1e9-4fdc-9ea0-45e3d9d90a70 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:49.050185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 931/1851] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:49.342161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:49.346343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:49.437936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc53511-5b96-4261-84e0-6355d94eab95 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:49.443172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:49.443849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:49.444129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:49.444403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] PATH_INFO: `/v3/users/39fb0f0c200b467c9a5a8521913ac797` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:49.445541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39fb0f0c200b467c9a5a8521913ac797)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:49.447461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:49.493734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39fb0f0c200b467c9a5a8521913ac797'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:49.494498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39fb0f0c200b467c9a5a8521913ac797'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:49.495121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39fb0f0c200b467c9a5a8521913ac797'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:49.507941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39fb0f0c200b467c9a5a8521913ac797'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:49.516832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39fb0f0c200b467c9a5a8521913ac797'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:49.535344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 921/1852] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:49 2022] DELETE /identity/v3/users/39fb0f0c200b467c9a5a8521913ac797 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:49.539705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:49.540026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:49.540306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:49.562798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:49.564310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:49.633059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 932/1853] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:49.647702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:49.649153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:49.685905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:49.709899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb25ecce-cad7-4ccd-8892-b69e2d2d9186 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:49.714089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:49.714705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:49.714986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:49.715256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:49.724302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:49.725733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:49.735403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 922/1854] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:50.025533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:50.027222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.050135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de75c33-0517-4156-a3ed-0be7718e5ddd None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:50.056608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:50.058210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.058686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.059419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] PATH_INFO: `/v3/projects/c64c13105d90473c852f2bec2a97bc55` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.063312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c64c13105d90473c852f2bec2a97bc55)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:50.066309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:50.092312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:50.144295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c64c13105d90473c852f2bec2a97bc55', 'request_id': 'req-945f401c-5f52-48e2-8cf7-ce7acf0a4450'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.154478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c64c13105d90473c852f2bec2a97bc55', 'request_id': 'req-945f401c-5f52-48e2-8cf7-ce7acf0a4450'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.163014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c64c13105d90473c852f2bec2a97bc55', 'request_id': 'req-945f401c-5f52-48e2-8cf7-ce7acf0a4450'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.183379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] The token cache is being invalidate because project c64c13105d90473c852f2bec2a97bc55 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:50.183932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.184892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.187113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 933/1855] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:50 2022] DELETE /identity/v3/projects/c64c13105d90473c852f2bec2a97bc55 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:50.191252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:50.203000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd064a1b-e0bf-4836-b0e1-541866c49e50 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:50.283965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:50.284604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.284879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.285153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] PATH_INFO: `/v3/users/59b082caa52e48d285d89b67a1bf86f4` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.286889 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59b082caa52e48d285d89b67a1bf86f4)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:50.289188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:50.329127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:50.330673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.339401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59b082caa52e48d285d89b67a1bf86f4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.340913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59b082caa52e48d285d89b67a1bf86f4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.341601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59b082caa52e48d285d89b67a1bf86f4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.344814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945f401c-5f52-48e2-8cf7-ce7acf0a4450 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:50.350715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:50.351339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.351615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.351921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] PATH_INFO: `/v3/users/b85e4cf98eeb4c2fa138184cabb4861b` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.353053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b85e4cf98eeb4c2fa138184cabb4861b)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:50.354959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:50.355349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59b082caa52e48d285d89b67a1bf86f4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.362640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a55f2a7a-a950-401d-ac50-9621b627b760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59b082caa52e48d285d89b67a1bf86f4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.376949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 923/1856] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:50 2022] DELETE /identity/v3/users/59b082caa52e48d285d89b67a1bf86f4 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:50.412093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b85e4cf98eeb4c2fa138184cabb4861b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.412840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b85e4cf98eeb4c2fa138184cabb4861b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.414043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b85e4cf98eeb4c2fa138184cabb4861b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.424961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b85e4cf98eeb4c2fa138184cabb4861b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.444042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b85e4cf98eeb4c2fa138184cabb4861b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.463588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 934/1857] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:50 2022] DELETE /identity/v3/users/b85e4cf98eeb4c2fa138184cabb4861b => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:50.467986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.468954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.469508 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.497089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:50.498446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.572014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:50.591571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 924/1858] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:50.600005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:50.601531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.674550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-651f8f71-b618-4e73-8d76-386349aacf0d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:50.679098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:50.679912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.680267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.680754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.697338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:50.699350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.706449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:50.709007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e9dcad-ff4b-448d-8f46-be81b5577426 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:50.717298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01545fe5-a109-4488-b854-dc7c8a395eb6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:50.719576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 935/1859] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:50.737211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:50.738101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.738672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.739055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] PATH_INFO: `/v3/projects/0a89ce7248ce4984914ceadaa23793de` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.740455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a89ce7248ce4984914ceadaa23793de)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:50.742785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:50.809584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a89ce7248ce4984914ceadaa23793de', 'request_id': 'req-c687fe52-3b44-4ef0-a528-6920c16ced8d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.820988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a89ce7248ce4984914ceadaa23793de', 'request_id': 'req-c687fe52-3b44-4ef0-a528-6920c16ced8d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.830275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a89ce7248ce4984914ceadaa23793de', 'request_id': 'req-c687fe52-3b44-4ef0-a528-6920c16ced8d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.849159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] The token cache is being invalidate because project 0a89ce7248ce4984914ceadaa23793de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:50.849450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.850109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c687fe52-3b44-4ef0-a528-6920c16ced8d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:50.851623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 925/1860] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:50 2022] DELETE /identity/v3/projects/0a89ce7248ce4984914ceadaa23793de => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:50.856753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.857239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.857518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.877986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:50.879255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.894520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:50.950725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 936/1861] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:50.959322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:50.959700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:50.960100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:50.982691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:50.984011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:50.993465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 926/1862] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:50.997499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.007926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-219975ba-a972-49b8-a2ff-c9d46dfc42aa None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.013408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.014150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.014488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.014819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.015940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:51.016403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.020372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.035820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 937/1863] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:51.039856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.050909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb69ba5-b1d2-4d02-9664-2314ff5ec404 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.056233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.056982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.057260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.057529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.058650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.060128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.102245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 927/1864] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:51 2022] POST /identity/v3/projects => generated 369 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:51.105920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.133563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56bf882-0f93-4e8b-9fcf-0c8594eb73b2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.191100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.193687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.216354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.217094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.217282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.217584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.218220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.220204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.250982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 938/1865] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:51 2022] POST /identity/v3/users => generated 285 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:51.252041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.261987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-706dd96e-f918-4b70-b251-f8f94f520087 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.268994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.269632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.269897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.270162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.271399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.273734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.289233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 939/1866] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:51.296363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.298321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055bafa5-300d-44bd-bb17-a567ec9f124f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.305416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.306143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.306570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.306882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] PATH_INFO: `/v3/projects/7e3a1cac927f40eab5aa9c4799ab1dd7` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.308197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e3a1cac927f40eab5aa9c4799ab1dd7)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.309404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d91bb65-2e1b-4bf7-a425-620e68d3ad0d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.310216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.321429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.322062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.322341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.322619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.323317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.325887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.338805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 940/1867] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:51.344118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.361044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cd41e5-0a34-406b-b866-7921a06d7f56 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.366919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.367790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.368077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.368353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] PATH_INFO: `/v3/projects/39b38cc36b8340b9bae844a28d7eff88/users/f3bd1d0f36bb4721975f465beea2f8cf/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.385374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=39b38cc36b8340b9bae844a28d7eff88, user_id=f3bd1d0f36bb4721975f465beea2f8cf, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.388602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2973cfa7-64cf-4587-a0e0-a642b82e23fa admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.391954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e3a1cac927f40eab5aa9c4799ab1dd7', 'request_id': 'req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.394758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:51.402509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e3a1cac927f40eab5aa9c4799ab1dd7', 'request_id': 'req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.413475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e3a1cac927f40eab5aa9c4799ab1dd7', 'request_id': 'req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.419717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 941/1868] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:51 2022] PUT /identity/v3/projects/39b38cc36b8340b9bae844a28d7eff88/users/f3bd1d0f36bb4721975f465beea2f8cf/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:51.433456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.433456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.433778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.435704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] The token cache is being invalidate because project 7e3a1cac927f40eab5aa9c4799ab1dd7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:51.436030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.437615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.447079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 928/1869] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:51 2022] DELETE /identity/v3/projects/7e3a1cac927f40eab5aa9c4799ab1dd7 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:51.449680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.452548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.475324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] MFA Rules not processed for user `f3bd1d0f36bb4721975f465beea2f8cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:51.480263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.526357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacf3dd9-95fe-44ef-9eca-f0d00deba7bb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.528353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:51.556193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 942/1870] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:51 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:51.560636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.561989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.597869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.598521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.599129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.599129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] PATH_INFO: `/v3/users/9705212556c04067bb8ef9ed7242b7c5` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.600284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9705212556c04067bb8ef9ed7242b7c5)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.602220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.651388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde30d4b-d6e4-4899-a22b-f7518b50145f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.656821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.657457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.657733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.657999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.658630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.660786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.675919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9705212556c04067bb8ef9ed7242b7c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.676578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9705212556c04067bb8ef9ed7242b7c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.677398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9705212556c04067bb8ef9ed7242b7c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.691604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 943/1871] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:51 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:51.694955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9705212556c04067bb8ef9ed7242b7c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.696200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.698245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.703078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9705212556c04067bb8ef9ed7242b7c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.723925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 929/1872] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:51 2022] DELETE /identity/v3/users/9705212556c04067bb8ef9ed7242b7c5 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:51.724909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.726548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.736314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:51.778250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb30de3-1a17-44f9-be4f-bad60f4d88b6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.817158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f15ae-6321-4dd2-93c5-632e3ab40733 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.824720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.825440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.825772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.826113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] PATH_INFO: `/v3/users/d2778483496244bf9b7e200b5a1d4576` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.827285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2778483496244bf9b7e200b5a1d4576)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.829266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.844860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.845733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.846014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.846334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.847381 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.850028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.876245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 944/1873] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:51 2022] POST /identity/v3/users => generated 290 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:51.877151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.881163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:51.904066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2778483496244bf9b7e200b5a1d4576'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.904765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2778483496244bf9b7e200b5a1d4576'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.905423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2778483496244bf9b7e200b5a1d4576'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.908285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:51.920867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a726db6-0ccf-4f47-a9bf-b7588969e5dc admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:51.921374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2778483496244bf9b7e200b5a1d4576'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.926261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:51.927799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:51.927935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:51.928221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] PATH_INFO: `/v3/users/1f34fc9e0d0442a79f5c7d884f4973a1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:51.929405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f34fc9e0d0442a79f5c7d884f4973a1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:51.930648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2778483496244bf9b7e200b5a1d4576'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:51.932418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:51.948519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 930/1874] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:51 2022] DELETE /identity/v3/users/d2778483496244bf9b7e200b5a1d4576 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:51.949630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:51.951600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.005911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f34fc9e0d0442a79f5c7d884f4973a1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.008206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f34fc9e0d0442a79f5c7d884f4973a1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.009430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f34fc9e0d0442a79f5c7d884f4973a1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.023286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f34fc9e0d0442a79f5c7d884f4973a1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.048946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd96cdc-30aa-420e-94b4-691353da5a06 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.056080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-943c5cc6-e56a-41fe-8a98-99afb39efcad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f34fc9e0d0442a79f5c7d884f4973a1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.056537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.057180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.057583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.060162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.066714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.068732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.080781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 945/1875] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:51 2022] DELETE /identity/v3/users/1f34fc9e0d0442a79f5c7d884f4973a1 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:52.082387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 931/1876] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:51 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:52.083901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.085337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2928f-a4ae-4925-b25a-7abde22ec807 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.085636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2928f-a4ae-4925-b25a-7abde22ec807 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.085908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f2928f-a4ae-4925-b25a-7abde22ec807 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.088850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.104650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712846e-4643-4987-80b9-48c58ee28f69 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.116699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a2f2928f-a4ae-4925-b25a-7abde22ec807 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:52.120218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a2f2928f-a4ae-4925-b25a-7abde22ec807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.125445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:52.215542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.216250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.216971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.217257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] PATH_INFO: `/v3/projects/513118e3b0244fdd9139abdd6d509975` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.218817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] RBAC: Authorizing `identity:delete_project(project_id=513118e3b0244fdd9139abdd6d509975)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.221134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.243239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 946/1877] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:52.249172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.249551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.250173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.275527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:52.276951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.284432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '513118e3b0244fdd9139abdd6d509975', 'request_id': 'req-e12ee243-73bc-496d-a381-eb7322d286ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.292000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '513118e3b0244fdd9139abdd6d509975', 'request_id': 'req-e12ee243-73bc-496d-a381-eb7322d286ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.298184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '513118e3b0244fdd9139abdd6d509975', 'request_id': 'req-e12ee243-73bc-496d-a381-eb7322d286ef'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.314770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] The token cache is being invalidate because project 513118e3b0244fdd9139abdd6d509975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:52.315938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.316833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:52.319292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 932/1878] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:52 2022] DELETE /identity/v3/projects/513118e3b0244fdd9139abdd6d509975 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:52.319951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.321418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.351762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 947/1879] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:52.352953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.357495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.381647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:52.410560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12ee243-73bc-496d-a381-eb7322d286ef admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.425666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.426343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.426637 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.426935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] PATH_INFO: `/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2/users/4c2bfbbf94474eb0a172f244097d764a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.449496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84aecfd12ac4b6e86e3fac2a333a6d2, user_id=4c2bfbbf94474eb0a172f244097d764a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.452840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d25e0c4-a0f1-4847-94b1-cb7430c2ed69 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.454400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d43bb-4ca8-4893-af85-f76ee85e7d6c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.460860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.461662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.461781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.462034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.464730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.474677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 933/1880] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:52 2022] PUT /identity/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2/users/4c2bfbbf94474eb0a172f244097d764a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:52.477882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.477882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.478951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.499151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:52.500501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.503843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.508226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.536280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 948/1881] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:52.545136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:52.545667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.546851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.562927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdcd46e-a3ab-4e36-bcbe-1d5798becdcc service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.586158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 934/1882] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:52.587190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.598314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5979ea-7d24-4355-9ead-bcf8012ba38f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.604539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.605276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.605555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.607243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.608623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.612536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd45b52a-8d6f-43b5-a4cc-1c8b3aee3d6d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.631965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 935/1883] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:52 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:52.631965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.631965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.631965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.647697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.648445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.648729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.649312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.659768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.661334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.673565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 949/1884] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:52.674670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.686568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e2d4d8-04b9-4624-8557-c25bb960f582 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.691037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:52.693171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.693973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.694348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.694717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] PATH_INFO: `/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2/users/4c2bfbbf94474eb0a172f244097d764a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.695013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.697338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b84aecfd12ac4b6e86e3fac2a333a6d2, user_id=4c2bfbbf94474eb0a172f244097d764a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.700489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43829c06-dae9-4d7f-a4c5-68484789017a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.713697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 936/1885] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:52.716247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 950/1886] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:52 2022] PUT /identity/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2/users/4c2bfbbf94474eb0a172f244097d764a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:52.718244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.729782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.729782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.729782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.738484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9176ddcb-7adc-466c-b548-3a9e714b4f5d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.821584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] MFA Rules not processed for user `4c2bfbbf94474eb0a172f244097d764a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:52.822141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:52.841886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.843314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.843844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.844379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.845624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:52.846177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.850125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.878588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 937/1887] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:52.882008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.897774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94737302-55c0-4626-ae08-027e91bbf780 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:52.905434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:52.906182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:52.906892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:52.906892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:52.907932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:52.910306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:52.956633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 938/1888] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/projects => generated 359 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:52.958809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.962752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 951/1889] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:52.976947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:52.979528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.044032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:53.078690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c198a9dd-5b31-4de1-bee9-26e4ee761305 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.088011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.089106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.089467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.089822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.090266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b21d2e-6999-4ffe-bd7e-80c4ecd63519 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.090738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.094225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.139039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 939/1890] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:52 2022] POST /identity/v3/users => generated 280 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:53.141595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.167022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc97de40-ffee-40b4-8366-427136930473 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.187357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.189119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.189482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.190445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.191070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.191335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.191575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.191783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.192383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.195805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.211722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 940/1891] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:52:53.215721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.227350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6018619-25f0-4bfa-8e75-95318d7dbb87 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.232677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.233370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.233719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.234061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.234762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.236743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.240565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:53.260674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 941/1892] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:53 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:52:53.262079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.284300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a86e7e-e438-4bce-88f7-a47ba8ecb1f9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.292856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.293798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.294115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.294453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] PATH_INFO: `/v3/projects/9dd81a07a767422dafb0b3b29de5f365/users/22e13a8a7be94b3c95297395f640d88a/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.299412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.301251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f7fe43-75ea-4758-a2c8-e35773e97064 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.331894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 952/1893] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:52 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:53.335918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dd81a07a767422dafb0b3b29de5f365, user_id=22e13a8a7be94b3c95297395f640d88a, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.338856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.371175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 942/1894] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:53 2022] PUT /identity/v3/projects/9dd81a07a767422dafb0b3b29de5f365/users/22e13a8a7be94b3c95297395f640d88a/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:53.385578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.386230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.386230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.392491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.395322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.454653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] MFA Rules not processed for user `22e13a8a7be94b3c95297395f640d88a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:53.456120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.545134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fa8265-d2e4-4432-9018-2c66ea8f93d8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.549096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.549662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.549941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.550241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.552134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.571452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 953/1895] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:53 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:53.572685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.576978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.631338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.632933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.641503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:53.651611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 943/1896] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:53.652855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.655768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.686095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec8e5fd7-36af-4c50-b088-49629e72abaf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.695906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.699468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.699779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.700060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] PATH_INFO: `/v3/projects/abeba54944f94d8f90fa340187af2412` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.702288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abeba54944f94d8f90fa340187af2412)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.705378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:53.771414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f4f0a-db05-4b62-9aad-97ebd1001d3e service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:53.813847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abeba54944f94d8f90fa340187af2412', 'request_id': 'req-8283cc7d-9676-42dd-8681-b57093b89412'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:53.825242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abeba54944f94d8f90fa340187af2412', 'request_id': 'req-8283cc7d-9676-42dd-8681-b57093b89412'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:53.836174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abeba54944f94d8f90fa340187af2412', 'request_id': 'req-8283cc7d-9676-42dd-8681-b57093b89412'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:53.839836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:53.858531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] The token cache is being invalidate because project abeba54944f94d8f90fa340187af2412 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:53.859084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:53.879024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:53.889046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 954/1897] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:53 2022] DELETE /identity/v3/projects/abeba54944f94d8f90fa340187af2412 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:53.889890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:53.898204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:53.898972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:53.899260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:53.899624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] PATH_INFO: `/v3/projects/4689bcc7738e402a88aa072d246690f3` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:53.905424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:53.910653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=4689bcc7738e402a88aa072d246690f3)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:53.920728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.028550 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8283cc7d-9676-42dd-8681-b57093b89412 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.037038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4689bcc7738e402a88aa072d246690f3', 'request_id': 'req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.056406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4689bcc7738e402a88aa072d246690f3', 'request_id': 'req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.075938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4689bcc7738e402a88aa072d246690f3', 'request_id': 'req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.093468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.094904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.095445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.096675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.098617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] The token cache is being invalidate because project 4689bcc7738e402a88aa072d246690f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:54.099604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.103344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.112318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.112318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 944/1898] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:53 2022] DELETE /identity/v3/projects/4689bcc7738e402a88aa072d246690f3 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:54.114814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.118534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.162864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:54.214517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.217440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.227921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 955/1899] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:53 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:54.229232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.231294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.254559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aee776a-88e0-414c-87a7-a3c9bb0eb2bc admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.262292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.263404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.263937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.264308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] PATH_INFO: `/v3/users/639c47f30ad74debadd7f220bd751d31` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.265946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=639c47f30ad74debadd7f220bd751d31)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.268059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.309548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f965ac08-25ae-4554-9114-c219c081272f service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.314281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.315033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.315313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.315582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] PATH_INFO: `/v3/users/a9956aaede974f4492f7f11128e34fd1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.316763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a9956aaede974f4492f7f11128e34fd1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.319284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.326217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '639c47f30ad74debadd7f220bd751d31'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.327256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '639c47f30ad74debadd7f220bd751d31'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.328131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '639c47f30ad74debadd7f220bd751d31'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.345461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '639c47f30ad74debadd7f220bd751d31'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.347708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:54.358011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '639c47f30ad74debadd7f220bd751d31'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.375952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 945/1900] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:54 2022] DELETE /identity/v3/users/639c47f30ad74debadd7f220bd751d31 => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:54.376872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.378089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a9956aaede974f4492f7f11128e34fd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.378220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.379608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a9956aaede974f4492f7f11128e34fd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.380665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a9956aaede974f4492f7f11128e34fd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.392541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a9956aaede974f4492f7f11128e34fd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.409850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07684b32-26fc-4b59-9549-0f24d5899923 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a9956aaede974f4492f7f11128e34fd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.455136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 956/1901] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:54 2022] DELETE /identity/v3/users/a9956aaede974f4492f7f11128e34fd1 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:54.479524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2e5e5-e8db-4108-85da-94938a9441fe admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.512043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b477-2f62-4de2-9e73-3dfa176031dc None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.512885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b477-2f62-4de2-9e73-3dfa176031dc None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.513525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f4b477-2f62-4de2-9e73-3dfa176031dc None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.517917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 957/1902] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:52:54 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 04:52:54.528769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.529282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.530952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.555817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72db6c52-d870-4925-894f-796caff713de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.556485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6c52-d870-4925-894f-796caff713de admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.556853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6c52-d870-4925-894f-796caff713de admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.557135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72db6c52-d870-4925-894f-796caff713de admin admin] PATH_INFO: `/v3/users/22e13a8a7be94b3c95297395f640d88a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.558376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6c52-d870-4925-894f-796caff713de admin admin] RBAC: Authorizing `identity:delete_user(user_id=22e13a8a7be94b3c95297395f640d88a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.560523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72db6c52-d870-4925-894f-796caff713de admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.571360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:54.573608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.648867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-72db6c52-d870-4925-894f-796caff713de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22e13a8a7be94b3c95297395f640d88a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.649810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-72db6c52-d870-4925-894f-796caff713de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22e13a8a7be94b3c95297395f640d88a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.650674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-72db6c52-d870-4925-894f-796caff713de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22e13a8a7be94b3c95297395f640d88a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.655085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:54.680902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-72db6c52-d870-4925-894f-796caff713de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22e13a8a7be94b3c95297395f640d88a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.685680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 958/1903] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:52:54 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:54.692946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-72db6c52-d870-4925-894f-796caff713de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22e13a8a7be94b3c95297395f640d88a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.710721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.712687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 946/1904] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:54 2022] DELETE /identity/v3/users/22e13a8a7be94b3c95297395f640d88a => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:54.713356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.717238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.717913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.718370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.748103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05436e5-98fc-4508-b947-3d2353f39218 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.748595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:54.750002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.758938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:54.851166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 947/1905] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:54.852428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.859965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.860961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.861390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.862972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.863820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.878106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5859c2c-c037-4faf-b1e7-2afbc8ee8ef3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.883309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.885594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.898132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:54.899199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 959/1906] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:54.899439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:54.899934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:54.900276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:54.900550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] PATH_INFO: `/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:54.901717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:54.902402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9534b2c6d7814c4caeb6fe35f5f6c5de)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:54.906955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:54.976316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9534b2c6d7814c4caeb6fe35f5f6c5de', 'request_id': 'req-8320e017-559a-4280-989b-1e59a76eecc5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.984344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce2b108-2f38-4e2d-a11a-abd54001a202 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:54.984562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9534b2c6d7814c4caeb6fe35f5f6c5de', 'request_id': 'req-8320e017-559a-4280-989b-1e59a76eecc5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:54.995600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9534b2c6d7814c4caeb6fe35f5f6c5de', 'request_id': 'req-8320e017-559a-4280-989b-1e59a76eecc5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.023560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] The token cache is being invalidate because project 9534b2c6d7814c4caeb6fe35f5f6c5de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:55.024092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.025019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.031406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 948/1907] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:54 2022] DELETE /identity/v3/projects/9534b2c6d7814c4caeb6fe35f5f6c5de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:55.031406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.032682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.084350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.084906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.085329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.085611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.091440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.124930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e017-559a-4280-989b-1e59a76eecc5 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.131930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.133254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.133544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.133826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] PATH_INFO: `/v3/projects/bf307949580e4b99bba0b86d920c0cd2` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.135476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf307949580e4b99bba0b86d920c0cd2)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.138443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.145253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:55.189254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.190952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bffba2d-8f09-4a33-b033-8becdae3795d service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.219752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 960/1908] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:55.219752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6124-aa07-4e70-a0dc-a27da7fd3422 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.219752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6124-aa07-4e70-a0dc-a27da7fd3422 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.219752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99e6124-aa07-4e70-a0dc-a27da7fd3422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.224710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:55.236994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf307949580e4b99bba0b86d920c0cd2', 'request_id': 'req-edf7868a-6754-437f-b9a5-ff25034a34bd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.251559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf307949580e4b99bba0b86d920c0cd2', 'request_id': 'req-edf7868a-6754-437f-b9a5-ff25034a34bd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.258564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf307949580e4b99bba0b86d920c0cd2', 'request_id': 'req-edf7868a-6754-437f-b9a5-ff25034a34bd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.275021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] The token cache is being invalidate because project bf307949580e4b99bba0b86d920c0cd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:55.275277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.275974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-edf7868a-6754-437f-b9a5-ff25034a34bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:55.278176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 949/1909] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:55 2022] DELETE /identity/v3/projects/bf307949580e4b99bba0b86d920c0cd2 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:55.290220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7697-6b3c-48ca-b296-7b3ccf3702ae None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.290220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7697-6b3c-48ca-b296-7b3ccf3702ae None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.290220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418c7697-6b3c-48ca-b296-7b3ccf3702ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.290514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e99e6124-aa07-4e70-a0dc-a27da7fd3422 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:55.291835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e99e6124-aa07-4e70-a0dc-a27da7fd3422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.327486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-418c7697-6b3c-48ca-b296-7b3ccf3702ae None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:55.329437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-418c7697-6b3c-48ca-b296-7b3ccf3702ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.450192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 961/1910] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:55.450330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 950/1911] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:55.459017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.459265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.459403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.459574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.459836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.460133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.481306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:55.482800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.484285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:55.485802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:55.492676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 962/1912] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:55.496957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.504209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 951/1913] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:55.505949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.529764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b05f8c1-f4c7-4471-8b06-efb19fc5f7c9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.535443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990e30e8-3c3b-4581-acf5-afbb33e69027 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.544329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.544975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.545895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.546176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.546829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:55.547129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.549175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.549742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.550688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.551197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.552517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.553999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:55.554708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.556896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.568919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 963/1914] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:52:55.569847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.582724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 952/1915] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:55.582915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede73872-599c-4e8b-b516-d224757db5d5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.584758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.590315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.591101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.591389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.592352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.593161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.596726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.604900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39320ea-b459-4f5a-9617-99277c7b2e0e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.619129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.620885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.620885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.620885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.621240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.623204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.636077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 964/1916] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/projects => generated 373 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:55.643866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.686120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 953/1917] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/projects => generated 409 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:55.687285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.751530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f5d653-e321-4d14-a8df-566b2238ff74 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.813442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:55.841715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f093f1-4347-404c-adb1-1cac6c9d63ec admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.844647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.845361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.845642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.846301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.847090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.850490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.853951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.856823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.857224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.858806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.861689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.870708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.890047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 965/1918] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/users => generated 287 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:55.892408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.953847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca724e2a-276e-4ffb-ad0c-fc547267cb39 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.959685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 954/1919] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:55 2022] POST /identity/v3/users => generated 305 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:55.964622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:55.970508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:55.971136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:55.971412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:55.971679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:55.972361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:55.976991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:55.987024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbd4e7b-8844-4b71-920c-06e411be7186 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:55.998020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.001463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 966/1920] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:56.004842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.005406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.005686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.006431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.008095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.009401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.028994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f157ea65-f410-4a8d-93f5-b5e5b201f858 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.034532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 955/1921] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:55 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:56.038913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.043806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.044437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.044713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.047113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.047355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:56.047791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.050709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.058763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7adc8b-9352-4d4e-8271-280e8d0c836e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.076995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.077624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.077900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.078170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.078947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.080582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.080864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 967/1922] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:56.081755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.103024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddd9f6d-e7a3-47c4-97a4-26f4e8d129b9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.107345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 956/1923] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:56 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:56.112690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.121046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.123186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.123689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.124938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] PATH_INFO: `/v3/projects/bca24f08174544088d7551aa5672bb3a/users/967fc7bbeb5449019b3bd8838659ee81/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.142648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcbc0543-b1d9-4762-b8db-cbe4cab834a2 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.157256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.158752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.159555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.160877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] PATH_INFO: `/v3/projects/42d7e3d6f22a42bf99eeff86e1146243/users/105a539c438b4385aadc5fe07673cbd0/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.163166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bca24f08174544088d7551aa5672bb3a, user_id=967fc7bbeb5449019b3bd8838659ee81, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.169880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd7641a-dde1-436f-b375-570e29edc923 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.203644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42d7e3d6f22a42bf99eeff86e1146243, user_id=105a539c438b4385aadc5fe07673cbd0, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.204477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 968/1924] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:56 2022] PUT /identity/v3/projects/bca24f08174544088d7551aa5672bb3a/users/967fc7bbeb5449019b3bd8838659ee81/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:56.215615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.215942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.216195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.220735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde04a29-5536-4699-8a31-bf672015e733 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.247640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 957/1925] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:56 2022] PUT /identity/v3/projects/42d7e3d6f22a42bf99eeff86e1146243/users/105a539c438b4385aadc5fe07673cbd0/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:56.259816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.260207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.260476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.304971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] MFA Rules not processed for user `967fc7bbeb5449019b3bd8838659ee81`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:56.307032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:56.337412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] MFA Rules not processed for user `105a539c438b4385aadc5fe07673cbd0`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:56.345043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:56.425683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 969/1926] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:56.430477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.496668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 958/1927] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:56.496668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.496668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:56.527008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e076fad6-f5f7-4c92-a6cf-24351284eaec None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.534113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.534736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.535012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.535279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.536503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.539376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.562158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:56.585508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 970/1928] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/projects => generated 373 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:56.586869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.629579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5387a44b-fd10-4b43-92e5-99ac543edcc0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.666223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ef17b8-6865-43ca-bf3e-0161b7049f4b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.671379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.672121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.672460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.672819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.673577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.675552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.712896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 971/1929] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/projects => generated 407 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:56.714557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.722339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.724171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.724471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.724756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] PATH_INFO: `/v3/projects/9dd81a07a767422dafb0b3b29de5f365` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.726782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dd81a07a767422dafb0b3b29de5f365)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.729032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.741122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:56.817578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd636bd-05eb-49b3-897e-0dec353b8739 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.828670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dd81a07a767422dafb0b3b29de5f365', 'request_id': 'req-d0a30b49-c030-4552-a239-31dcaf22bde7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:56.837653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dd81a07a767422dafb0b3b29de5f365', 'request_id': 'req-d0a30b49-c030-4552-a239-31dcaf22bde7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:56.846434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dd81a07a767422dafb0b3b29de5f365', 'request_id': 'req-d0a30b49-c030-4552-a239-31dcaf22bde7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:56.887769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] The token cache is being invalidate because project 9dd81a07a767422dafb0b3b29de5f365 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:52:56.887769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:56.887769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:56.887769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 959/1930] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:56 2022] DELETE /identity/v3/projects/9dd81a07a767422dafb0b3b29de5f365 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:56.887769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:56.888462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:56.919503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.920155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.920430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.920701 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.921345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.923409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1e9966-1d01-4f51-8fb0-a56b99cfd029 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.959088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 972/1931] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/users => generated 293 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:56.960672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.960960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.961230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.976924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a30b49-c030-4552-a239-31dcaf22bde7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:56.981926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:56.982611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:56.982888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:56.983158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:56.983814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:56.985740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fce552b-d235-444c-8d6a-3f8a00ca322c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:56.987300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:56.990202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:57.010458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 973/1932] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:57.011461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.016079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:57.047375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 960/1933] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:56 2022] POST /identity/v3/users => generated 310 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:57.052373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.052812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.053215 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.062822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b065d6-5f3f-4b37-b6ef-b731b2066e11 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.076026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.076661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.077044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.077199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.077852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.079679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.082277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:57.084718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:57.093679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:57.101697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 961/1934] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:57.106572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.123580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107650ae-0021-4156-9f0e-906ea06760dc None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.129682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.130485 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.131622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.131622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.133044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.135645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.144965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 974/1935] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:57.147478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.153871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 962/1936] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:57.154754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.169415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7357aec1-9f06-4981-8f9b-3a04fa893935 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.179454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.181233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.182170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.183509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] PATH_INFO: `/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa/users/82b25b51ce79493f87aa9bb727476abb/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.185714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40986b1-7004-4e71-98cc-d1abec0dd91e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.207097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0c1f93ca54c7eb736564d31bbccfa, user_id=82b25b51ce79493f87aa9bb727476abb, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.210909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.218054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.218542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.218817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.219126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.220318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:52:57.220606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.222703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.237734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 975/1937] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:52:57.238291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.244397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 963/1938] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:57 2022] PUT /identity/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa/users/82b25b51ce79493f87aa9bb727476abb/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:57.245635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.264190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c069e2ce-beb0-41e8-a592-c469cad12125 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.312104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:57.347343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9b63a2-c72c-4b7c-b8a8-35a06601e69a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.352259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.354046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.354416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.355237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] PATH_INFO: `/v3/projects/80004bd7127c4f1c8f01763079ecd1eb/users/f4499d3a10b34d36ac9a8f3853abba76/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.358681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.360645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.361230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.362285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.363345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.370105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.391656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80004bd7127c4f1c8f01763079ecd1eb, user_id=f4499d3a10b34d36ac9a8f3853abba76, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.398257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.424272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 964/1939] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:57 2022] POST /identity/v3/projects => generated 373 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:57.425249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.428006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 976/1940] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:57 2022] PUT /identity/v3/projects/80004bd7127c4f1c8f01763079ecd1eb/users/f4499d3a10b34d36ac9a8f3853abba76/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:57.429253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.546369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c788660-93b6-4a03-9b7c-de763d4c6f30 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.549942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ca215b-ff43-441b-8202-90a5de685ab9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.556671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.556671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.556671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.557059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.557358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.557535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.557813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.558179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.558368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.558835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.560602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.560872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.583965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 965/1941] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:57.585108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.598144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e55b14-ea4d-443d-8de4-1036617bb49d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.609953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 977/1942] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:57 2022] POST /identity/v3/users => generated 287 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:57.609953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.610988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.611789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.612099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.612523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.613198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.615262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.625819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17402555-8612-46ae-8e90-83005d2e1b22 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.633236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.633236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.633731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.634101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] PATH_INFO: `/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa/users/82b25b51ce79493f87aa9bb727476abb/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.644508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bd0c1f93ca54c7eb736564d31bbccfa, user_id=82b25b51ce79493f87aa9bb727476abb, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.648218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.651262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 966/1943] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:57.652864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.662284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 978/1944] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:57 2022] PUT /identity/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa/users/82b25b51ce79493f87aa9bb727476abb/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:57.663303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.677715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc581c1-90d3-4498-b796-711673029a42 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.756874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:57.767652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.768660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.769157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.769569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.771439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.774260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e35053a9-a5db-4d91-83d0-80b805f46a91 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.778855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c8a297-0b30-43de-8426-240edb8bc35b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:57.785596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:57.786446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.786771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.787044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] PATH_INFO: `/v3/projects/80004bd7127c4f1c8f01763079ecd1eb/users/f4499d3a10b34d36ac9a8f3853abba76/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.788680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 967/1945] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:57.789926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:57.790211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:57.790526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:57.794445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=80004bd7127c4f1c8f01763079ecd1eb, user_id=f4499d3a10b34d36ac9a8f3853abba76, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:57.797352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:57.812523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 979/1946] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:57 2022] PUT /identity/v3/projects/80004bd7127c4f1c8f01763079ecd1eb/users/f4499d3a10b34d36ac9a8f3853abba76/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:57.814218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:57.875537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] MFA Rules not processed for user `82b25b51ce79493f87aa9bb727476abb`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:57.877107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.007418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601dcfde-cc7e-4c75-aa4c-78d624557ea9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.014143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.014143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.017660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.017660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.017660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.017955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:58.019084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c29e4bd-0401-4bab-9fbd-b72e7b6a9a80 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.035815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 980/1947] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:57 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:58.042557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.043028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.043413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.082953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 968/1948] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:57 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:58.084615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.090859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.123605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] MFA Rules not processed for user `f4499d3a10b34d36ac9a8f3853abba76`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:58.125087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.131772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be0168-7a13-4a5b-8ea4-6510835d992e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.141298 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.142067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.142224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.142962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] PATH_INFO: `/v3/users/f3bd1d0f36bb4721975f465beea2f8cf` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.143720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3bd1d0f36bb4721975f465beea2f8cf)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.149666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.271718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3bd1d0f36bb4721975f465beea2f8cf'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:58.273063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3bd1d0f36bb4721975f465beea2f8cf'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:58.273301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3bd1d0f36bb4721975f465beea2f8cf'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:58.296583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 981/1949] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:58.296583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.310289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3bd1d0f36bb4721975f465beea2f8cf'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:58.327406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3bd1d0f36bb4721975f465beea2f8cf'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:58.332491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ca6dac-be07-4594-820f-59a1838b678d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.347120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.350466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.350759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.351036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] PATH_INFO: `/v3/projects/bc0c249738d24e528b1aed81d140ddf7/users/8e6d5333942e47aaa525a7e29bdd85f9/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.355966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 969/1950] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:58 2022] DELETE /identity/v3/users/f3bd1d0f36bb4721975f465beea2f8cf => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:58.357725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.360249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.391134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bc0c249738d24e528b1aed81d140ddf7, user_id=8e6d5333942e47aaa525a7e29bdd85f9, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.407449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.446114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 982/1951] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:58 2022] PUT /identity/v3/projects/bc0c249738d24e528b1aed81d140ddf7/users/8e6d5333942e47aaa525a7e29bdd85f9/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:52:58.447017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.449214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.469802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f14153e-96e5-4e88-b87c-1e1842cb3437 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.517419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:58.546214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bca4bf5-c620-400e-94d7-20ef2000cd80 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.549892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.550502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.550774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.551041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.553614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.569146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.570267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.570616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.570965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.572942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.589974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:58.628257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.630128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88529234-7315-42c0-8a9a-b7d83b4f58f1 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.641813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 983/1952] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 195 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:58.649477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.650037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.650396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.658702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.661638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b009f0-34c6-4814-b796-c6b7b90ab97b service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.672951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 970/1953] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:58.674697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.675125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.675535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.680694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:58.690538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.718463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] MFA Rules not processed for user `8e6d5333942e47aaa525a7e29bdd85f9`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:58.720632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.774429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 984/1954] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:58.788086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.789517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.835306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 971/1955] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:58 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:58.840711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.842896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:58.858329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f6c7eb-7491-45d6-a01d-ed0789e8dcb1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.864101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.865018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.865435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.865823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.866672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.868968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.904848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63b91c7-298c-4601-af9e-f91ac2148038 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:58.918108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:58.918735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:58.919008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:58.919280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:58.922702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 972/1956] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:52:58 2022] POST /identity/v3/projects => generated 375 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:52:58.926311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.930114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:58.931675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:58.943484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 985/1957] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:52:58.944383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:58.962055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13496e08-c03f-4ee0-91e4-127f95ac4193 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.023419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:59.066360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ad5ab5-9ac5-4419-bc66-7a97f5d437fe admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.076118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.076916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.077062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.077486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.078512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.079660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.079660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.080480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.081230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.081723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.085011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.144267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 973/1958] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:52:58 2022] POST /identity/v3/users => generated 294 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:52:59.149290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.161747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617e05d3-5ade-41c2-b2d3-022fb50a7892 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.168794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.169879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.170335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.170793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.171004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.172072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.173482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.175759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.180237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:59.196652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 974/1959] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:59.201501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.206640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 986/1960] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:58 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 262 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:59.213007 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2964f9da-7fc8-44ef-9e2c-fa857f9b7d80 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.220816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.221624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.222002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.222314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] PATH_INFO: `/v3/projects/c753367f9b5a40f787740fda06c0fa0c/users/2e2ef6802da64aa1ae710b6681afd90b/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.234624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.236125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.249103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c753367f9b5a40f787740fda06c0fa0c, user_id=2e2ef6802da64aa1ae710b6681afd90b, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.252490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.258820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f17b8bf-3f60-4996-a9e5-b6d657a76bdd service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.265479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.266747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.267023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.267414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] PATH_INFO: `/v3/users/967fc7bbeb5449019b3bd8838659ee81` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.268780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=967fc7bbeb5449019b3bd8838659ee81)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.271881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.279830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 975/1961] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:59 2022] PUT /identity/v3/projects/c753367f9b5a40f787740fda06c0fa0c/users/2e2ef6802da64aa1ae710b6681afd90b/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:59.283552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.352999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '967fc7bbeb5449019b3bd8838659ee81'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.353700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '967fc7bbeb5449019b3bd8838659ee81'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.355116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '967fc7bbeb5449019b3bd8838659ee81'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.376546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ac33cc-9b6a-4d1c-871c-03c76ba35fb7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.380230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '967fc7bbeb5449019b3bd8838659ee81'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.383498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.384434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.384797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.385164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.386028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.388820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.402941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 976/1962] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:52:59 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:52:59.407353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c37f8c9a-029f-46f9-8bce-1fea0ab28af6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '967fc7bbeb5449019b3bd8838659ee81'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.407584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.410430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.429373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 987/1963] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:52:59 2022] DELETE /identity/v3/users/967fc7bbeb5449019b3bd8838659ee81 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:59.429574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd38dd4c-9b43-40c2-bf7e-68015cb15327 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.435696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.435696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.435696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.462967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:59.464773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.503039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.504136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.504425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.504761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] PATH_INFO: `/v3/projects/c753367f9b5a40f787740fda06c0fa0c/users/2e2ef6802da64aa1ae710b6681afd90b/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.508622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c753367f9b5a40f787740fda06c0fa0c, user_id=2e2ef6802da64aa1ae710b6681afd90b, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.512341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043d46bb-ca18-4e91-a6c6-11f96597a409 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.526480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 977/1964] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:52:59 2022] PUT /identity/v3/projects/c753367f9b5a40f787740fda06c0fa0c/users/2e2ef6802da64aa1ae710b6681afd90b/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:52:59.535514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:59.539467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.539786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.540060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.560602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 988/1965] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:52:59.561726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.564163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.589604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] MFA Rules not processed for user `2e2ef6802da64aa1ae710b6681afd90b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:52:59.590881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.656520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63ada8c-8cfc-4b0b-977e-e2587f4e3e4c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.759705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:59.785395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 978/1966] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:52:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:52:59.786804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.788243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.793865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.794759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.795413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.796533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.872252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbb257-ef6d-49be-99cc-5f329c55abcf None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.874552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.876034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.879514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:52:59.880290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:52:59.880628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:52:59.881415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] PATH_INFO: `/v3/projects/39b38cc36b8340b9bae844a28d7eff88` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:52:59.882126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39b38cc36b8340b9bae844a28d7eff88)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:52:59.884179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:52:59.887297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 989/1967] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:52:59.888037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:52:59.889428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:52:59.955218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39b38cc36b8340b9bae844a28d7eff88', 'request_id': 'req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.962831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8cf826-d52a-4a62-bf9c-b1192aaa51a9 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:52:59.983756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39b38cc36b8340b9bae844a28d7eff88', 'request_id': 'req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:52:59.985530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:52:59.990844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39b38cc36b8340b9bae844a28d7eff88', 'request_id': 'req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.009465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] The token cache is being invalidate because project 39b38cc36b8340b9bae844a28d7eff88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:00.009995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.011382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.013587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 979/1968] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:52:59 2022] DELETE /identity/v3/projects/39b38cc36b8340b9bae844a28d7eff88 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:00.018214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:00.020821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.024951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:00.026010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.026431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.026844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.029184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.115272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa9313-5d63-4dde-9307-4dae8b9c4c0f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:00.121226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:00.122171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.122653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.123182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] PATH_INFO: `/v3/users/4c2bfbbf94474eb0a172f244097d764a` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.124525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c2bfbbf94474eb0a172f244097d764a)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:00.126607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:00.155554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:00.164329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:00.165935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:00.179936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 990/1969] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:52:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:00.202818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c2bfbbf94474eb0a172f244097d764a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.203900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c2bfbbf94474eb0a172f244097d764a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.204916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c2bfbbf94474eb0a172f244097d764a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.222212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c2bfbbf94474eb0a172f244097d764a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.227578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:00.228940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.255967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c2bfbbf94474eb0a172f244097d764a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.258507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623eff05-a8ea-4c60-9df4-85d905dd2a46 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:00.265781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:00.266432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.266709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.266996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] PATH_INFO: `/v3/projects/bca24f08174544088d7551aa5672bb3a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.268724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=bca24f08174544088d7551aa5672bb3a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:00.274186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:00.280581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 980/1970] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:00 2022] DELETE /identity/v3/users/4c2bfbbf94474eb0a172f244097d764a => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:00.364827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bca24f08174544088d7551aa5672bb3a', 'request_id': 'req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.374959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bca24f08174544088d7551aa5672bb3a', 'request_id': 'req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.383377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bca24f08174544088d7551aa5672bb3a', 'request_id': 'req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.396486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] The token cache is being invalidate because project bca24f08174544088d7551aa5672bb3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:00.396813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.397528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.399557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 991/1971] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:00 2022] DELETE /identity/v3/projects/bca24f08174544088d7551aa5672bb3a => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:00.403553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:00.405491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.488048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41eb645f-893e-40d4-b8c0-86572f2e2bc7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:00.626372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:00.627017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.627299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.627567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] PATH_INFO: `/v3/users/82b25b51ce79493f87aa9bb727476abb` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.631797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:00.633507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.640579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82b25b51ce79493f87aa9bb727476abb)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:00.649229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:00.657496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3960adb-98fa-42ec-a02b-7f41c0b3ce1a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:00.673136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:00.673923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.674199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.674467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] PATH_INFO: `/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.678074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b84aecfd12ac4b6e86e3fac2a333a6d2)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:00.680380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:00.761369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82b25b51ce79493f87aa9bb727476abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.762328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82b25b51ce79493f87aa9bb727476abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.762772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82b25b51ce79493f87aa9bb727476abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.776497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:00.790408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b84aecfd12ac4b6e86e3fac2a333a6d2', 'request_id': 'req-b0366647-a89f-4690-adcc-1d4b290a29a7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.797487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:00.800969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82b25b51ce79493f87aa9bb727476abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.809450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b84aecfd12ac4b6e86e3fac2a333a6d2', 'request_id': 'req-b0366647-a89f-4690-adcc-1d4b290a29a7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.812783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-113c6727-8d6f-48d4-ac8b-caefa2f22710 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82b25b51ce79493f87aa9bb727476abb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.820754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b84aecfd12ac4b6e86e3fac2a333a6d2', 'request_id': 'req-b0366647-a89f-4690-adcc-1d4b290a29a7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.831956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 981/1972] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:00 2022] DELETE /identity/v3/users/82b25b51ce79493f87aa9bb727476abb => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:00.836239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] The token cache is being invalidate because project b84aecfd12ac4b6e86e3fac2a333a6d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:00.836541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.837241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0366647-a89f-4690-adcc-1d4b290a29a7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:00.838950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 992/1973] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:00 2022] DELETE /identity/v3/projects/b84aecfd12ac4b6e86e3fac2a333a6d2 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:00.847427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.850621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.851159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:00.877038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:00.878943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:00.979908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 982/1974] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:00.993744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:00.994028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:00.994303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.047005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:01.048359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.119392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 993/1975] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:01.119611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.133354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44253ee0-e3cc-45c3-9960-0ca89935a667 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.138236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.138902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.139186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.139462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.140407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:01.140711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.142338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.159308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 983/1976] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:01.160996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.172816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fff2e4-f473-471d-bcce-12d508fe3b63 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.181545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.182229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.182572 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.182866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.183509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.185716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.227219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 994/1977] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/projects => generated 379 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:01.231695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.243311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a739b-0e5a-49ce-8fac-8ec062b1c5a1 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.328803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.329720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.329999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.330669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.330968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.333526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.358395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 984/1978] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/users => generated 290 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:01.362279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.373369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a152d609-9135-41a5-bb24-36a183b9e9e9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.378226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.378835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.379109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.379428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.380481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.382341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.392791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 995/1979] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:01.396880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.429633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1664dc-c645-4054-afce-3f502f50a82a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.436332 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.437224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.437396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.437827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.444222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.444222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.459639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 985/1980] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:01 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:01.464335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.475057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.476281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072fe76f-7510-4894-be37-89eda0069004 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.477242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.482697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.483367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.483653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.483979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] PATH_INFO: `/v3/projects/da1962164bf342af9bbaabb4dd7f006b/users/8b550c499ba1452fa8f310a02a0f6a84/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.495670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19565bd6-14ad-4e81-9da3-065dba909750 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.502473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da1962164bf342af9bbaabb4dd7f006b, user_id=8b550c499ba1452fa8f310a02a0f6a84, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.505852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f2c84a-408d-4686-b576-b90eccc268c1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.507016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.507673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.508201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.508669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] PATH_INFO: `/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.509974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bd0c1f93ca54c7eb736564d31bbccfa)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.511775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.533187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 996/1981] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:01 2022] PUT /identity/v3/projects/da1962164bf342af9bbaabb4dd7f006b/users/8b550c499ba1452fa8f310a02a0f6a84/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:01.546086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.546761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.547254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.555861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:01.575157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bd0c1f93ca54c7eb736564d31bbccfa', 'request_id': 'req-7ce9c633-daea-4960-a96d-ec11b8ac70f7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:01.581428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bd0c1f93ca54c7eb736564d31bbccfa', 'request_id': 'req-7ce9c633-daea-4960-a96d-ec11b8ac70f7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:01.586939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] MFA Rules not processed for user `8b550c499ba1452fa8f310a02a0f6a84`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:01.588269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.592753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bd0c1f93ca54c7eb736564d31bbccfa', 'request_id': 'req-7ce9c633-daea-4960-a96d-ec11b8ac70f7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:01.614779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] The token cache is being invalidate because project 8bd0c1f93ca54c7eb736564d31bbccfa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:01.615076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:01.615801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7ce9c633-daea-4960-a96d-ec11b8ac70f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:01.622930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 986/1982] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:01 2022] DELETE /identity/v3/projects/8bd0c1f93ca54c7eb736564d31bbccfa => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:01.624442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d1b8-3431-4c64-8a8e-db024fd34688 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.624772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d1b8-3431-4c64-8a8e-db024fd34688 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.625052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8653d1b8-3431-4c64-8a8e-db024fd34688 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.652038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8653d1b8-3431-4c64-8a8e-db024fd34688 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:01.653246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8653d1b8-3431-4c64-8a8e-db024fd34688 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.673571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 997/1983] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:01.677374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.678778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.776835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 987/1984] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:01.784187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.784490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.784725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.814479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27b41f6-2f93-4435-9b8e-15e6f840116e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.823961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.824671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.824997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.825345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.826440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.826620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:01.829545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:01.831472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.849085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=3,keystone:SELECT=95,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:01.855071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 988/1985] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:01.859996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.871348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588818c3-3449-4fb8-8628-04249e85cd93 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.876873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.877872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.878192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.881341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.881524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 998/1986] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/projects => generated 379 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:01.881606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:01.881606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.881606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.882492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.899424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 989/1987] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:53:01.900337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:01.913171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d801672-58a9-431b-a99b-1ac181833e6a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.972951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfac86f-c547-4a44-b70c-f89a7637c8fe admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:01.979592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.980452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.980794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.981130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.982390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.984619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:01.990753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:01.991371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:01.991654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:01.991967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:01.992607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:01.994684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.016095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 999/1988] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/users => generated 290 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:02.021773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.027885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 990/1989] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:01 2022] POST /identity/v3/projects => generated 377 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:02.033309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.038301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0add0a3-4100-4fc5-8bdf-9fd6ad874c07 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.059156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:02.149364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.150074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.150354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.150776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.151425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.153527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.163026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1dfded2-c347-4616-8e1e-8597f978ff35 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.168695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1000/1990] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:02.173352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.177460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.178135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.178448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.178693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.179342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.181386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.202146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7923f78a-ddf2-4e2b-84c5-3a4bdc82d7a0 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.212580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.213222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.213506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.216397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.217396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.219109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.230853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 991/1991] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/users => generated 289 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:02.234576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.252611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1001/1992] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:02.253168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64564900-e745-49cf-bda7-906e39cddcdd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.255432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.259924 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.260792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.260792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.261129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.261821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.263864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.271241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8734f4ac-51c5-415e-a46d-47d623a1a3ee admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.277111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.278303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.278597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.278873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] PATH_INFO: `/v3/projects/3d2ae1d130e64ee4a7b9f03732a64235/users/3659fd31220e4d1e9d6e9b5dd6766b92/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.280324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 992/1993] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:02.284132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.300007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3d2ae1d130e64ee4a7b9f03732a64235, user_id=3659fd31220e4d1e9d6e9b5dd6766b92, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.302733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1902a9ab-968b-45ed-98f9-93a5f8d924b3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.305223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311be288-628c-457d-a827-bfb44214b041 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.312423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.313050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.313498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.313793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.314514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.316226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.328786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1002/1994] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:02 2022] PUT /identity/v3/projects/3d2ae1d130e64ee4a7b9f03732a64235/users/3659fd31220e4d1e9d6e9b5dd6766b92/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:02.336918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 993/1995] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:02.341407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.341691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.341967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.345881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.367370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b741e59b-04fa-425c-a07b-2523bc59eaa6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.375013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] MFA Rules not processed for user `3659fd31220e4d1e9d6e9b5dd6766b92`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:02.377218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:02.415995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:02.465589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.466430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.466711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.467771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] PATH_INFO: `/v3/projects/b444ee390d064e45b688e83c65cd6599/users/01ca8e434a554f7dac21af41ae1d9fb7/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.478436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1003/1996] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:02.482576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.491701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b444ee390d064e45b688e83c65cd6599, user_id=01ca8e434a554f7dac21af41ae1d9fb7, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.495853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf450cd-762c-4e36-bb4f-31e270a15bd8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.496001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b70e2a7-6c6b-4066-8f50-9893b6ee5796 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.502073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.503312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.503721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.504163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.505388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.507430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.519792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 994/1997] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:02 2022] PUT /identity/v3/projects/b444ee390d064e45b688e83c65cd6599/users/01ca8e434a554f7dac21af41ae1d9fb7/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:02.527723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.528124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.528640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.552472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1004/1998] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/projects => generated 377 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:02.553962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.569981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] MFA Rules not processed for user `01ca8e434a554f7dac21af41ae1d9fb7`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:02.571239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:02.664215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78cb31ce-ad77-4d8d-920b-d3e3306074cd admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.664661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:02.673230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.673709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 995/1999] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:02.674016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.674304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.674410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.674584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.675202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.677313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.685160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecea6af-1768-4a2f-959f-7db4770a02fc None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.690321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.691126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.691348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.691825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.696337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.699270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.706408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1005/2000] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/users => generated 295 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:02.712340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.725350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966fa216-4b00-44a7-acb3-4a1dae26a1b5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.731649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.732611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.733229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.733461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.734105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.735797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.745147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 996/2001] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/projects => generated 377 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:02.746144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.748618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1006/2002] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:02.752573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.762945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a3bc43-4c70-4547-a658-349ff52aa61b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.822316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a734ce2-a97f-449a-8ac9-9b1a685f3201 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.828851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.829448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.829724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.830050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.830690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.832693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.833858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.834645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.834986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.835325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] PATH_INFO: `/v3/projects/316af152671742e490185414ce023539/users/b98bb21451d548eda103b5f6bd037820/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.851034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316af152671742e490185414ce023539, user_id=b98bb21451d548eda103b5f6bd037820, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.853761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.855894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 997/2003] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:02 2022] POST /identity/v3/users => generated 295 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:02.859571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.870112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8a8e39-b594-45e6-9a15-9c9864fd9dab admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.870533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1007/2004] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:02 2022] PUT /identity/v3/projects/316af152671742e490185414ce023539/users/b98bb21451d548eda103b5f6bd037820/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:02.874241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.886774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:02.936971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.937608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.937955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.938292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.939002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.940639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.942964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382883f-7bd8-48f9-8373-612b511bb360 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.948169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.949090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.949371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.949644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.950293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.951919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:02.953633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 998/2005] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:02.957351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.967823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1008/2006] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:02 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:02.971056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:02.972932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5593bcf-634d-4df0-bc16-54274369e644 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.978459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.979136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.979415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.980187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] PATH_INFO: `/v3/projects/8eeaa66c37e4451996ba811c2158b150/users/267a573107824dc58bc4c26619a259e9/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.984242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec18baf-feb6-46e6-8763-1055844dab9e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:02.990501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:02.991170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:02.991459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:02.991772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] PATH_INFO: `/v3/projects/316af152671742e490185414ce023539/users/b98bb21451d548eda103b5f6bd037820/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:02.993920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=316af152671742e490185414ce023539, user_id=b98bb21451d548eda103b5f6bd037820, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:02.996755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.005766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeaa66c37e4451996ba811c2158b150, user_id=267a573107824dc58bc4c26619a259e9, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.009177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad7b3aa-8738-4f51-99dd-0698a6b28f9d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.010695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1009/2007] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:02 2022] PUT /identity/v3/projects/316af152671742e490185414ce023539/users/b98bb21451d548eda103b5f6bd037820/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:03.011543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.013398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.057886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 999/2008] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:02 2022] PUT /identity/v3/projects/8eeaa66c37e4451996ba811c2158b150/users/267a573107824dc58bc4c26619a259e9/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:03.059812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.060316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.061675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.093887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff41777-6725-42e0-a944-36bc1f2d63f9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.101905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] MFA Rules not processed for user `b98bb21451d548eda103b5f6bd037820`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:03.103259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.138386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:03.158297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.159276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.159755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.160046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] PATH_INFO: `/v3/users/8e6d5333942e47aaa525a7e29bdd85f9` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.161743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8e6d5333942e47aaa525a7e29bdd85f9)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.163990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.191859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1000/2009] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:03.191859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.207438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff9b08f-a43c-41b8-b886-977a3c109c1b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.213463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.214178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.214454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.214676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.215316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.217055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.226024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:03.228826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1001/2010] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:03.231856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8e6d5333942e47aaa525a7e29bdd85f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:03.232784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.233314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8e6d5333942e47aaa525a7e29bdd85f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:03.234139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8e6d5333942e47aaa525a7e29bdd85f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:03.235229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.246719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8e6d5333942e47aaa525a7e29bdd85f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:03.269774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8e6d5333942e47aaa525a7e29bdd85f9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:03.296781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1010/2011] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:03 2022] DELETE /identity/v3/users/8e6d5333942e47aaa525a7e29bdd85f9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:03.296781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.297399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.327036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3022209a-92f3-4b87-b3db-1b3177463d0b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.392661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.393764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.394258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.394728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.396795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.408518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945e36f1-ce57-4ac8-8d45-992b764a4eb2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.416957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.417228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.417526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.417829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] PATH_INFO: `/v3/projects/8eeaa66c37e4451996ba811c2158b150/users/267a573107824dc58bc4c26619a259e9/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.420168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eeaa66c37e4451996ba811c2158b150, user_id=267a573107824dc58bc4c26619a259e9, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.424026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34d37156-e026-448e-a870-fcf5ac0d94ca admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.460748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1011/2012] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:03 2022] PUT /identity/v3/projects/8eeaa66c37e4451996ba811c2158b150/users/267a573107824dc58bc4c26619a259e9/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:03.471069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.471360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.471638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.495425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:03.496696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.517455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.518932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18475634-0f6b-40c4-b0cf-0ae59493dd76 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.529787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1002/2013] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:03.531287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.531568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.532103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.579359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] MFA Rules not processed for user `267a573107824dc58bc4c26619a259e9`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:03.581327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.593714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:03.614247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1012/2014] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:03.621453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.624196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.696616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1003/2015] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:03 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:03.697715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.699116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.757289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1992d87a-5c9d-4483-b400-dab827eaea28 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.761315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.761931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.762808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.763093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.768184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:03.769375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7861cb-ebd2-4e53-8366-e34ce32cdb76 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.774693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.776586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.776882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.777182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.791654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.792395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:03.795078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.807207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1004/2016] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:03.861350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:03.863246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:03.879491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1013/2017] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:03.916837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:03.941214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce48fca-d89e-4009-b32e-e59dfecfbc9f service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:03.950500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:03.951124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:03.951393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:03.951692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:03.955229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:04.084556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:04.086016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:04.099119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1005/2018] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:03 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:04.222620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:04.224653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:04.262667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe7a6af-cdcc-41ec-8aac-479862689ce8 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:04.276909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:04.280202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:04.281078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:04.281505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] PATH_INFO: `/v3/projects/bc0c249738d24e528b1aed81d140ddf7` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:04.286860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bc0c249738d24e528b1aed81d140ddf7)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:04.291577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:04.433953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bc0c249738d24e528b1aed81d140ddf7', 'request_id': 'req-64f6a646-d9fc-4f09-9c16-704b9c3c3820'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.453059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bc0c249738d24e528b1aed81d140ddf7', 'request_id': 'req-64f6a646-d9fc-4f09-9c16-704b9c3c3820'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.462882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bc0c249738d24e528b1aed81d140ddf7', 'request_id': 'req-64f6a646-d9fc-4f09-9c16-704b9c3c3820'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.480555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] The token cache is being invalidate because project bc0c249738d24e528b1aed81d140ddf7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:04.480555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.482074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.487125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1014/2019] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:04 2022] DELETE /identity/v3/projects/bc0c249738d24e528b1aed81d140ddf7 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:04.491585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:04.510650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74df33dc-446c-42e0-b78b-3734248961d7 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:04.619895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:04.655145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:04.657164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:04.657460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:04.658206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] PATH_INFO: `/v3/users/2e2ef6802da64aa1ae710b6681afd90b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:04.660623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e2ef6802da64aa1ae710b6681afd90b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:04.676954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:04.739268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e2ef6802da64aa1ae710b6681afd90b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.739975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e2ef6802da64aa1ae710b6681afd90b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.740754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e2ef6802da64aa1ae710b6681afd90b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.765529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e2ef6802da64aa1ae710b6681afd90b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.777595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-248965d2-8c87-4e48-bf91-aec880b11593 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e2ef6802da64aa1ae710b6681afd90b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:04.797790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1006/2020] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:04 2022] DELETE /identity/v3/users/2e2ef6802da64aa1ae710b6681afd90b => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:04.915640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:04.918675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:04.949686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64f6a646-d9fc-4f09-9c16-704b9c3c3820 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.028363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.030147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.030662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.031157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] PATH_INFO: `/v3/users/105a539c438b4385aadc5fe07673cbd0` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.032710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=105a539c438b4385aadc5fe07673cbd0)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.035251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:05.105385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:05.141633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '105a539c438b4385aadc5fe07673cbd0'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.142954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '105a539c438b4385aadc5fe07673cbd0'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.143614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '105a539c438b4385aadc5fe07673cbd0'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.157672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '105a539c438b4385aadc5fe07673cbd0'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.172989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '105a539c438b4385aadc5fe07673cbd0'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.187698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1015/2021] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:04 2022] DELETE /identity/v3/users/105a539c438b4385aadc5fe07673cbd0 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:05.192800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.193284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.193751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.219974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:05.221579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:05.288445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1007/2022] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:05.298239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:05.302816 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:05.303054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:05.308050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:05.332015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283ac17-5b8d-4203-a4dd-edf13cc782e7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.345674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.346710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.346710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.346959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] PATH_INFO: `/v3/projects/c753367f9b5a40f787740fda06c0fa0c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.348155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c753367f9b5a40f787740fda06c0fa0c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.357295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:05.404152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a728fd0c-e356-4214-80bc-8c451ecd39b2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.408075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.408940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.409377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.409568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.424551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.426828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685370f0-0ae2-41fb-9dd9-602a14e907fa service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:05.463560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1016/2023] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:05.464180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c753367f9b5a40f787740fda06c0fa0c', 'request_id': 'req-cd9b8856-9b93-4f11-be5f-faf060846a97'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.477160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c753367f9b5a40f787740fda06c0fa0c', 'request_id': 'req-cd9b8856-9b93-4f11-be5f-faf060846a97'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.482660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:05.484593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c753367f9b5a40f787740fda06c0fa0c', 'request_id': 'req-cd9b8856-9b93-4f11-be5f-faf060846a97'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.510931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] The token cache is being invalidate because project c753367f9b5a40f787740fda06c0fa0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:05.511524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.512432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cd9b8856-9b93-4f11-be5f-faf060846a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:05.514945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1008/2024] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:05 2022] DELETE /identity/v3/projects/c753367f9b5a40f787740fda06c0fa0c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:05.522241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.522470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.522815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.548674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:05.549915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:05.648963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1017/2025] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:05.659080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.659370 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.659679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.716620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:05.721018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:05.743665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1009/2026] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:05.749090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:05.761294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6003cef2-a5e3-4e21-9358-adc5edfd77d7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.780044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.780734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.781144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.781496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.782218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:05.782566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.784435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:05.812994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1018/2027] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:05.817413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:05.830177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280f3a30-fe65-4fe0-8ebd-1679259c8367 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.838770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.839583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.839911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.840224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.840869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.844241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:05.892102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1010/2028] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:05 2022] POST /identity/v3/projects => generated 383 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:05.896656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:05.911889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7894e946-f45a-4b34-a465-5df3b12e9087 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:05.965656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:05.990862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:05.991484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:05.991799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:05.992221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:05.993071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:05.995532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.008312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.010487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:06.027000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1147a8-2905-4e3a-b831-dc26671818f7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.033046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1019/2029] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:05 2022] POST /identity/v3/users => generated 292 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:06.034445 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.039442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.040447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.040948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.041293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] PATH_INFO: `/v3/projects/42d7e3d6f22a42bf99eeff86e1146243` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.042576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42d7e3d6f22a42bf99eeff86e1146243)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.044510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.045616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695b3a99-125c-42dc-994b-3c155d236120 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.050440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.051031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.051912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.052195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.052838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.054571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.065066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1020/2030] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:06.068926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.079074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f0bc7b-b9ae-472f-a3c6-97c778531b4d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.085055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.085698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.086018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.086238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.086945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.088610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.099780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1021/2031] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:06.104143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.115604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d10052-7746-4c79-9370-3d8a647b7037 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.142830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42d7e3d6f22a42bf99eeff86e1146243', 'request_id': 'req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.153532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42d7e3d6f22a42bf99eeff86e1146243', 'request_id': 'req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.163641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42d7e3d6f22a42bf99eeff86e1146243', 'request_id': 'req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.186644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] The token cache is being invalidate because project 42d7e3d6f22a42bf99eeff86e1146243 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:06.186943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.187609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.190420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1011/2032] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:06 2022] DELETE /identity/v3/projects/42d7e3d6f22a42bf99eeff86e1146243 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:06.193386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.194076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.194186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.194632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.194632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] PATH_INFO: `/v3/projects/ddaa5fcaa62842389456cbeb7e6221fb/users/a6c0403cdf49487f8f60a132f5ac8120/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.199190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:06.214376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d77675c5-fe8d-4dc6-b0d8-05af5761cf16 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.219022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ddaa5fcaa62842389456cbeb7e6221fb, user_id=a6c0403cdf49487f8f60a132f5ac8120, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.224941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cba9255-39ab-42ed-9c95-378304953e84 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.240438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1022/2033] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:06 2022] PUT /identity/v3/projects/ddaa5fcaa62842389456cbeb7e6221fb/users/a6c0403cdf49487f8f60a132f5ac8120/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:06.243719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.244489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.244842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.245200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] PATH_INFO: `/v3/users/f4499d3a10b34d36ac9a8f3853abba76` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.246528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4499d3a10b34d36ac9a8f3853abba76)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.251185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.251762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.252130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.252623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.301855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] MFA Rules not processed for user `a6c0403cdf49487f8f60a132f5ac8120`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:06.303439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:06.330238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4499d3a10b34d36ac9a8f3853abba76'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.331071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4499d3a10b34d36ac9a8f3853abba76'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.331710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4499d3a10b34d36ac9a8f3853abba76'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.345971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4499d3a10b34d36ac9a8f3853abba76'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.355688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4499d3a10b34d36ac9a8f3853abba76'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.370414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1012/2034] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:06 2022] DELETE /identity/v3/users/f4499d3a10b34d36ac9a8f3853abba76 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:06.379980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1023/2035] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:06.392482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.395844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:06.417319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=78,keystone:INSERT=4,keystone:DELETE=18 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:06.479719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b684c8c1-c3f2-406a-85e3-89afe8d4c4a0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.483484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.484171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.484418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.484693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.548335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.550891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c01d17-2cb4-4e97-9ab7-eced958c67eb service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.561162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1013/2036] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:06 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:06.672651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:06.674196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:06.707547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:06.751360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa764600-a773-4bde-aa29-916518c70f55 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:06.813062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:06.813710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.813992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.814262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] PATH_INFO: `/v3/projects/80004bd7127c4f1c8f01763079ecd1eb` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.815760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] RBAC: Authorizing `identity:delete_project(project_id=80004bd7127c4f1c8f01763079ecd1eb)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:06.818469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:06.885102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80004bd7127c4f1c8f01763079ecd1eb', 'request_id': 'req-01cf541b-7318-44c9-9033-5d4aa772846d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.896853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80004bd7127c4f1c8f01763079ecd1eb', 'request_id': 'req-01cf541b-7318-44c9-9033-5d4aa772846d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.903856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80004bd7127c4f1c8f01763079ecd1eb', 'request_id': 'req-01cf541b-7318-44c9-9033-5d4aa772846d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.915447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] The token cache is being invalidate because project 80004bd7127c4f1c8f01763079ecd1eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:06.915855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.917050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-01cf541b-7318-44c9-9033-5d4aa772846d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:06.920279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1024/2037] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:06 2022] DELETE /identity/v3/projects/80004bd7127c4f1c8f01763079ecd1eb => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:06.925735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:06.927696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:06.928400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:06.952387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:06.953895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:07.087287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1014/2038] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:07.096460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.096738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.097165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.135053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:07.137396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:07.148734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1025/2039] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:07.153206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.168777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db9b714-cc89-4709-8f62-6d4d68af436b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.177003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.178225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.178709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.179152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.180425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:07.180939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.183142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.199204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1015/2040] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:07.203599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.212873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee23e5-8b4a-45b7-91c1-af5717af63b6 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.217861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.218614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.218896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.219225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.219984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.221731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.268566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1026/2041] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/projects => generated 367 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:07.269643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.279802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d9fb3-3ad4-479a-9a37-3a7912bfa454 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.336540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:07.343854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.344512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.344793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.345066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.345720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.347754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.370899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1016/2042] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/users => generated 284 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:07.374676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.385899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd012db-df80-4917-8d27-be4104491a7a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.393810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.395885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.396404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.396886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.398080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.400764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.415810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1027/2043] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:07.417640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.429584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52142621-adba-4ff9-bd14-0877900012da admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.434902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.435529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.435842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.436111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.437505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.438426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983feea3-b47a-4186-a39c-3b59661dd937 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.455070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1017/2044] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:07.459452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.475254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bfddcb-a011-41f6-bbb4-a35d9fb32d21 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.485232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.485905 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.486166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.486435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] PATH_INFO: `/v3/projects/2537235d2e5c44ff876f1c6243143bc2/users/553281d8c62c4177bb9b5be13923a3ee/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.503305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2537235d2e5c44ff876f1c6243143bc2, user_id=553281d8c62c4177bb9b5be13923a3ee, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.506111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.509576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:07.534966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1028/2045] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:07 2022] PUT /identity/v3/projects/2537235d2e5c44ff876f1c6243143bc2/users/553281d8c62c4177bb9b5be13923a3ee/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:07.536487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.536968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.537478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.572613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] MFA Rules not processed for user `553281d8c62c4177bb9b5be13923a3ee`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:07.573743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:07.648521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1018/2046] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:07.653278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.723705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e009014-cdfc-4e70-936c-fbb13f964ad6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.728628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.729235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.729510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.729774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.730401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.732359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.759164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1029/2047] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:07.763438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.774925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b657bd33-3539-4a80-95fa-c169e914f140 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.831377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.831932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.832211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.832987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.833663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.835981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.857530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1019/2048] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:07 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:07.861508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.871510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d053653-eaaa-4a4f-b86d-4d51c8b93d4f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.876058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.876646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.876917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.877182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.877807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.879408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.889642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1030/2049] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:07.893930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.904259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4935dc97-d0ea-4186-8e89-c2f855b9819d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:07.909064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:07.909709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:07.909990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:07.910265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] PATH_INFO: `/v3/projects/df483a6b7e144c878e99d58367338e45/users/d18b2b4a734342f6a377b01fdb65ced6/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:07.926159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=df483a6b7e144c878e99d58367338e45, user_id=d18b2b4a734342f6a377b01fdb65ced6, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:07.928852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:07.942818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1020/2050] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:07 2022] PUT /identity/v3/projects/df483a6b7e144c878e99d58367338e45/users/d18b2b4a734342f6a377b01fdb65ced6/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:07.947449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:07.958269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8999ca88-db67-48af-9853-37d24a7d87b8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.016052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.016652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.016923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.017195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.017817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.019620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db90b49-818d-4954-a4c6-8b605ad108fe admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:08.030935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1031/2051] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:07 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:08.036426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:08.046547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7369100f-28c9-4006-b51e-f1f1d1bdf0cf admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.051041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.051722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.052052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.052333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] PATH_INFO: `/v3/projects/df483a6b7e144c878e99d58367338e45/users/d18b2b4a734342f6a377b01fdb65ced6/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.054237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] RBAC: Authorizing `identity:create_grant(project_id=df483a6b7e144c878e99d58367338e45, user_id=d18b2b4a734342f6a377b01fdb65ced6, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.056873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:08.068106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1021/2052] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:08 2022] PUT /identity/v3/projects/df483a6b7e144c878e99d58367338e45/users/d18b2b4a734342f6a377b01fdb65ced6/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:08.079803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.080090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.080494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.110964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] MFA Rules not processed for user `d18b2b4a734342f6a377b01fdb65ced6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:08.112214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:08.180074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:08.202076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1032/2053] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:08 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:08.207461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:08.209854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:08.230345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:08.274421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:08.275887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:08.276090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9edbea7-b1f2-44df-8e84-640af193d34a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.279699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.280336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.281300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.281577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.283415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:08.287941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0652f62a-ccb4-47b6-9fa2-fe2ea65e17e6 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.292169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.292789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.293104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.293476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.303228 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.305110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:08.317497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1033/2054] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:08.354603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.356042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:08.366432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1022/2055] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:08.468951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:08.477646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e33acb70-d81a-4770-b712-33faf0cbb042 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.481468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.482061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.482337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.482604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.549764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.551960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f40a2-53fb-46f0-a369-e00e33209b62 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:08.561315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1034/2056] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:08 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:08.897870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:08.899501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:08.986428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28843b80-c35e-416b-96a4-34df0ae47217 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:08.991891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:08.992806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:08.993184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:08.993538 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] PATH_INFO: `/v3/users/8b550c499ba1452fa8f310a02a0f6a84` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:08.995136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] RBAC: Authorizing `identity:delete_user(user_id=8b550c499ba1452fa8f310a02a0f6a84)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:08.997216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.044462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8b550c499ba1452fa8f310a02a0f6a84'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.045105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8b550c499ba1452fa8f310a02a0f6a84'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.045711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8b550c499ba1452fa8f310a02a0f6a84'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.058791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8b550c499ba1452fa8f310a02a0f6a84'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.063375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:09.067127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8b550c499ba1452fa8f310a02a0f6a84'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.080863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1023/2057] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:08 2022] DELETE /identity/v3/users/8b550c499ba1452fa8f310a02a0f6a84 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:09.085559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.086042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.086137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.105738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:09.107261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.168997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1035/2058] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:09.180184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:09.181698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.239709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91ae4a8-d7df-4bc1-a50b-fe33ab4e0ffd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:09.243873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:09.244487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.244762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.245030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.253901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:09.255350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.265884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1024/2059] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:09.544884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:09.547544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.562249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6efae55-d290-4fdc-bd1c-893f5aa206b3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:09.571880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:09.572743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.573140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.573564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] PATH_INFO: `/v3/users/a6c0403cdf49487f8f60a132f5ac8120` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.575075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c0403cdf49487f8f60a132f5ac8120)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:09.577508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.636927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c0403cdf49487f8f60a132f5ac8120'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.637108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:09.637625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c0403cdf49487f8f60a132f5ac8120'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.638286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c0403cdf49487f8f60a132f5ac8120'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.638398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.647110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c0403cdf49487f8f60a132f5ac8120'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.653833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-438eae75-eb91-42d9-9359-9061aa5ac2bc service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:09.658602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:09.659355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.659630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.659968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] PATH_INFO: `/v3/projects/da1962164bf342af9bbaabb4dd7f006b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.661491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] RBAC: Authorizing `identity:delete_project(project_id=da1962164bf342af9bbaabb4dd7f006b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:09.661618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:09.663079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.663873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-2eb7e8b0-244f-40b5-a963-b4738f3f9f88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c0403cdf49487f8f60a132f5ac8120'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.685199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1036/2060] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:09 2022] DELETE /identity/v3/users/a6c0403cdf49487f8f60a132f5ac8120 => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:09.689233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.689535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.689804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.720522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:09.722237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.733640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da1962164bf342af9bbaabb4dd7f006b', 'request_id': 'req-d791c5a0-4ddd-4029-8930-24a09850799c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.740307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da1962164bf342af9bbaabb4dd7f006b', 'request_id': 'req-d791c5a0-4ddd-4029-8930-24a09850799c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.745761 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da1962164bf342af9bbaabb4dd7f006b', 'request_id': 'req-d791c5a0-4ddd-4029-8930-24a09850799c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.758711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] The token cache is being invalidate because project da1962164bf342af9bbaabb4dd7f006b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:09.759000 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.759627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.761147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1025/2061] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:09 2022] DELETE /identity/v3/projects/da1962164bf342af9bbaabb4dd7f006b => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:09.766748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:09.768140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.788219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1037/2062] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:09.799007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:09.800405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:09.834285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d791c5a0-4ddd-4029-8930-24a09850799c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:09.838942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:09.839571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.839932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.840212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] PATH_INFO: `/v3/users/3659fd31220e4d1e9d6e9b5dd6766b92` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.841355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3659fd31220e4d1e9d6e9b5dd6766b92)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:09.843261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.858076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e0f478-b0ab-424a-93c4-9188ddbb803d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:09.858246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:09.861875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:09.862483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:09.862760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:09.863032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:09.872478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:09.873899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:09.884267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1038/2063] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:09.894568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3659fd31220e4d1e9d6e9b5dd6766b92'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.895947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3659fd31220e4d1e9d6e9b5dd6766b92'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.896601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3659fd31220e4d1e9d6e9b5dd6766b92'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.909783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3659fd31220e4d1e9d6e9b5dd6766b92'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.916806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3659fd31220e4d1e9d6e9b5dd6766b92'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:09.934376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1026/2064] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:09 2022] DELETE /identity/v3/users/3659fd31220e4d1e9d6e9b5dd6766b92 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:10.387782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:10.401030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc95c3b-8aba-4781-bf21-c9125004ec91 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:10.504780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:10.505666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:10.506010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:10.506369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] PATH_INFO: `/v3/projects/3d2ae1d130e64ee4a7b9f03732a64235` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:10.507665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] RBAC: Authorizing `identity:delete_project(project_id=3d2ae1d130e64ee4a7b9f03732a64235)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:10.509817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:10.559311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:10.573723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3d2ae1d130e64ee4a7b9f03732a64235', 'request_id': 'req-f148c1bf-1b13-4310-b9f9-f384631aee9a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.582286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3d2ae1d130e64ee4a7b9f03732a64235', 'request_id': 'req-f148c1bf-1b13-4310-b9f9-f384631aee9a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.589378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3d2ae1d130e64ee4a7b9f03732a64235', 'request_id': 'req-f148c1bf-1b13-4310-b9f9-f384631aee9a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.601171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] The token cache is being invalidate because project 3d2ae1d130e64ee4a7b9f03732a64235 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:10.601528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.602128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.604514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1039/2065] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:10 2022] DELETE /identity/v3/projects/3d2ae1d130e64ee4a7b9f03732a64235 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:10.608349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:10.610003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:10.626593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e69e03-5233-428f-91e2-914b80d63e58 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:10.720861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:10.723694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:10.739691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:10.740861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:10.741341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:10.741860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] PATH_INFO: `/v3/users/b98bb21451d548eda103b5f6bd037820` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:10.759710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b98bb21451d548eda103b5f6bd037820)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:10.762299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:10.809928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f148c1bf-1b13-4310-b9f9-f384631aee9a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:10.820432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:10.821091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:10.823014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:10.823335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] PATH_INFO: `/v3/projects/ddaa5fcaa62842389456cbeb7e6221fb` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:10.825412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ddaa5fcaa62842389456cbeb7e6221fb)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:10.827345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:10.840047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b98bb21451d548eda103b5f6bd037820'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.841042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b98bb21451d548eda103b5f6bd037820'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.841811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b98bb21451d548eda103b5f6bd037820'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.856925 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b98bb21451d548eda103b5f6bd037820'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.867265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bb7de33b-108b-4fe1-9dbd-f71ddd376ba1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b98bb21451d548eda103b5f6bd037820'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.881738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1027/2066] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:10 2022] DELETE /identity/v3/users/b98bb21451d548eda103b5f6bd037820 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:10.881929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ddaa5fcaa62842389456cbeb7e6221fb', 'request_id': 'req-5a20d249-353a-4635-a426-6835a2ed6a7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.892882 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ddaa5fcaa62842389456cbeb7e6221fb', 'request_id': 'req-5a20d249-353a-4635-a426-6835a2ed6a7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.899651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ddaa5fcaa62842389456cbeb7e6221fb', 'request_id': 'req-5a20d249-353a-4635-a426-6835a2ed6a7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.914447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] The token cache is being invalidate because project ddaa5fcaa62842389456cbeb7e6221fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:10.914733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.915752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5a20d249-353a-4635-a426-6835a2ed6a7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:10.919957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1040/2067] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:10 2022] DELETE /identity/v3/projects/ddaa5fcaa62842389456cbeb7e6221fb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:10.922759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:10.923037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:10.923312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:10.947008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:10.948445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:10.955915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:11.019515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1028/2068] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:11.028143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.028556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.028933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.055021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:11.057362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.074634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.081071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1041/2069] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:11.096523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb77c839-41a5-4903-8181-d6918df32c22 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.101779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.102394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.102669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.102989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.103914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:11.104218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.106477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.123107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1029/2070] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:11.128117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.149146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a5387-04b6-44c9-bb0c-19a28f8aaab9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.154042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.155193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.155193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.155367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.156036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.158017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.189259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1042/2071] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/projects => generated 399 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:11.200964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.212561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.215386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.217535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88332934-54a8-4294-ab42-e38805c4f2bb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.260061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:11.287679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.288633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.289336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.289612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.290574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.292798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.305169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df04b13b-149c-49b1-96b7-d1c668b52f5b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.310725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.311566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.311680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.311950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] PATH_INFO: `/v3/projects/316af152671742e490185414ce023539` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.313181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] RBAC: Authorizing `identity:delete_project(project_id=316af152671742e490185414ce023539)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.315061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.327097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1030/2072] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/users => generated 300 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:11.328505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.344682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01339fec-370f-4660-840d-b1374a9e8b79 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.352886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.353831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.354075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.354513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.355291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.357486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.385452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1031/2073] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:11.389379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.389530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '316af152671742e490185414ce023539', 'request_id': 'req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:11.406486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca1d68e-7f9a-47da-8c5a-0d00947dfa43 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.419775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '316af152671742e490185414ce023539', 'request_id': 'req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:11.427972 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '316af152671742e490185414ce023539', 'request_id': 'req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:11.452570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] The token cache is being invalidate because project 316af152671742e490185414ce023539 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:11.452912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:11.455248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4bb39a25-3ce2-41f6-8b78-b6191e73f6af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:11.459292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1043/2074] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:11 2022] DELETE /identity/v3/projects/316af152671742e490185414ce023539 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:11.466056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680225e-51e1-4cdf-bf7f-fd40e624a81f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.466341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680225e-51e1-4cdf-bf7f-fd40e624a81f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.466600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680225e-51e1-4cdf-bf7f-fd40e624a81f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.490682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f680225e-51e1-4cdf-bf7f-fd40e624a81f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:11.492721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f680225e-51e1-4cdf-bf7f-fd40e624a81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.531468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.532430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.534372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.535010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.535962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.538330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.557334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1032/2075] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:11 2022] GET /identity/v3/roles => generated 1420 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:11.563993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.570178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.599263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b466ef35-a580-4d55-839d-d16114b3dc49 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.615990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.616742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.617030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.617306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] PATH_INFO: `/v3/projects/d85578836f2b4734a3355c47bc796891/users/1b24d7081add4b69befea78b90ca76a5/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.624773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1044/2076] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:11.628521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.631869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.632409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.647132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:11.655201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d85578836f2b4734a3355c47bc796891, user_id=1b24d7081add4b69befea78b90ca76a5, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.658053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b965b-7086-45ed-80c1-cd5882f8d89e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.659822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:11.662253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.676996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1045/2077] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:11.678019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.691185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1033/2078] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:11 2022] PUT /identity/v3/projects/d85578836f2b4734a3355c47bc796891/users/1b24d7081add4b69befea78b90ca76a5/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:11.701683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc0dbd3b-bbe5-4938-beaf-6adc62298f2b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.708196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911944c-cd50-4670-a715-b62f96096706 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.708479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911944c-cd50-4670-a715-b62f96096706 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.709010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b911944c-cd50-4670-a715-b62f96096706 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.804693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b911944c-cd50-4670-a715-b62f96096706 None None] MFA Rules not processed for user `1b24d7081add4b69befea78b90ca76a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:11.806264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b911944c-cd50-4670-a715-b62f96096706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.833839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:11.867132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.867831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.868146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.868472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.873105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:11.873487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.877887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.903810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1046/2079] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:11.908754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.924872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b2efa1-0a58-42fc-be73-d4c03b5d1f06 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:11.925798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1034/2080] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:11.932161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:11.933129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:11.933410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:11.933777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:11.934551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:11.936354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:11.940374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911944c-cd50-4670-a715-b62f96096706 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:11.942026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b911944c-cd50-4670-a715-b62f96096706 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:11.979055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1047/2081] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/projects => generated 371 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:11.983257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.033410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b911944c-cd50-4670-a715-b62f96096706 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.071102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3387e4f7-3f44-44dc-b13a-ac65e18cbf59 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.076207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.076952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.077334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.077709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.078460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.098399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.128002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.128827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.129324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.129911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.145534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1048/2082] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:11 2022] POST /identity/v3/users => generated 286 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:12.150232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.173513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b1f220-89a9-4a79-b501-08656cc9e6f3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.186180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.187005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.187293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.187568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.188892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.190661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.208178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:12.214239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1049/2083] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:12.219867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.222431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.226025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.238103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81fa734-cfd2-4f22-95d1-50008eef4189 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.239965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1035/2084] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:11 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:12.253935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.255471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.255867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.256476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.257237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.259335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3194abea-1104-44d8-865c-bf93feabe26f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.277211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1050/2085] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:12 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:12.278320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.297438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd5ee50-ced7-47f5-9611-6e6980c49240 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.308443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.310360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.310806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.311266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] PATH_INFO: `/v3/projects/e002b1c9b98a4620a8ca70fb9cdbe12f/users/a4059304586e442cb33e721ff589b1b4/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.341157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e002b1c9b98a4620a8ca70fb9cdbe12f, user_id=a4059304586e442cb33e721ff589b1b4, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.344189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.372450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1036/2086] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:12 2022] PUT /identity/v3/projects/e002b1c9b98a4620a8ca70fb9cdbe12f/users/a4059304586e442cb33e721ff589b1b4/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:12.376234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.377040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.377523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.426194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] MFA Rules not processed for user `a4059304586e442cb33e721ff589b1b4`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:12.427769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:12.628117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1051/2087] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:12.702422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.705229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:12.782025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531ed6e7-e276-4f06-90ea-0442071653ec admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:12.794428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:12.795153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:12.795494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:12.797137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:12.822543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:12.826380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81c7c45-d1d7-4750-8092-fba08fe9b702 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:12.853449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1037/2088] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:12 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:12.885638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:12.915377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:13.053931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f294959a-c750-4ce8-9440-ad4c3804851c None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:13.080687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:13.081342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:13.081614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:13.081880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] PATH_INFO: `/v3/users/a4059304586e442cb33e721ff589b1b4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:13.085994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4059304586e442cb33e721ff589b1b4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:13.090039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:13.201920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4059304586e442cb33e721ff589b1b4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:13.204162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4059304586e442cb33e721ff589b1b4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:13.205127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4059304586e442cb33e721ff589b1b4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:13.227088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4059304586e442cb33e721ff589b1b4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:13.269499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4059304586e442cb33e721ff589b1b4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:13.301703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1052/2089] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:12 2022] DELETE /identity/v3/users/a4059304586e442cb33e721ff589b1b4 => generated 0 bytes in 416 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:13.308381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:13.308381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:13.308381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:13.353828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:13.358728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:13.531880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1038/2090] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:13.560607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:13.564515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:13.743294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626a9a27-6921-41cb-b9e2-2847ca7baebd admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:13.754520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:13.755179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:13.755458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:13.756505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:13.781621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:13.783809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b99666b-9b08-4f71-b33e-2419579286d9 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:13.798395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1053/2091] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:14.355052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:14.356910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:14.371415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac275d31-135c-4eab-946c-794ba20d2666 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:14.378528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:14.379910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:14.381228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:14.381767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] PATH_INFO: `/v3/projects/e002b1c9b98a4620a8ca70fb9cdbe12f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:14.383350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e002b1c9b98a4620a8ca70fb9cdbe12f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:14.387146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:14.485411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e002b1c9b98a4620a8ca70fb9cdbe12f', 'request_id': 'req-d31bb9d6-f63b-473b-9ca8-498cd958b455'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:14.497390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e002b1c9b98a4620a8ca70fb9cdbe12f', 'request_id': 'req-d31bb9d6-f63b-473b-9ca8-498cd958b455'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:14.503879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e002b1c9b98a4620a8ca70fb9cdbe12f', 'request_id': 'req-d31bb9d6-f63b-473b-9ca8-498cd958b455'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:14.516278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=93,keystone:INSERT=1,keystone:DELETE=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:14.537582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] The token cache is being invalidate because project e002b1c9b98a4620a8ca70fb9cdbe12f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:14.537876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:14.538559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d31bb9d6-f63b-473b-9ca8-498cd958b455 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:14.544290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1039/2092] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:14 2022] DELETE /identity/v3/projects/e002b1c9b98a4620a8ca70fb9cdbe12f => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:14.548997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:14.549658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:14.550584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:14.578571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:14.585333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:14.659049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:14.722086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1054/2093] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:14.730711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:14.730711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:14.730711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:14.792563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:14.794142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:14.821360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1040/2094] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:14.823243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:14.840208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fdc1c5-c650-4c85-9825-cfbcf1d736ac None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:14.857178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:14.857811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:14.858088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:14.858527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:14.859340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:14.859825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:14.863195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:14.900238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1055/2095] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:53:14.904673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:14.916116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6136a0b5-d96a-415a-b46a-016d9dc7261f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:14.921576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:14.922569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:14.923152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:14.923569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:14.924397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:14.927067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:14.983184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1041/2096] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:14 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:14.984437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:14.998901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926b9473-81c5-499a-b72f-d946691bb38a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.091321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.091907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.092350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.092917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.094000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.096521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.122697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.128211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.145892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1056/2097] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:14 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:15.147281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.152679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b568419f-c1c6-4114-a7c6-179af8aef81f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.157903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.158552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.158832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.159108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] PATH_INFO: `/v3/users/553281d8c62c4177bb9b5be13923a3ee` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.161054 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=553281d8c62c4177bb9b5be13923a3ee)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.163219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.174543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb48791-e4ab-48a5-a028-4a4434889eba admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.192889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.194856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.195479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.196184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.197835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.203679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.221032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1057/2098] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:15.225897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.236936 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed771d08-8dc7-4517-b0d6-7dd5322f660f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.242101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.242724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.243003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.243295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.244003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.245968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.258941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '553281d8c62c4177bb9b5be13923a3ee'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:15.260822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1058/2099] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:15.265869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.268752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '553281d8c62c4177bb9b5be13923a3ee'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:15.272455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '553281d8c62c4177bb9b5be13923a3ee'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:15.272859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.293760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '553281d8c62c4177bb9b5be13923a3ee'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:15.303466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc779ad-11b5-4bef-9fd7-39f07b369cc0 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.307292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-81c3ae33-9f74-4d12-8081-a0c682ad52bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '553281d8c62c4177bb9b5be13923a3ee'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:15.314665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.315661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.316018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.316462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] PATH_INFO: `/v3/projects/1dc94575ef3a46a5a4ee7774d770142f/users/a57754413a924b878ad6332f1225534d/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.327962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1042/2100] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:15 2022] DELETE /identity/v3/users/553281d8c62c4177bb9b5be13923a3ee => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:15.333276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.333811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.334238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.337614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dc94575ef3a46a5a4ee7774d770142f, user_id=a57754413a924b878ad6332f1225534d, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.341345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b610a2-1886-4264-ba9b-be091fa7c95e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.358580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:15.361176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.364060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1059/2101] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:15 2022] PUT /identity/v3/projects/1dc94575ef3a46a5a4ee7774d770142f/users/a57754413a924b878ad6332f1225534d/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:15.375085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.375630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.375954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.418413 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] MFA Rules not processed for user `a57754413a924b878ad6332f1225534d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:15.419970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.482645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1043/2102] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:15.492556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.493893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.504313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:15.511888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1060/2103] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:15.520787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:15.522161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:15.534895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=3,keystone:DELETE=11,keystone:SELECT=86 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:15.556009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff362c-01bc-4bb6-b077-67306a1ba129 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.559891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.560490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.560767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.561034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.570752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.572331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.581772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33774bc4-0439-425b-ba5d-4282c3109e31 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:15.584698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1044/2104] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:15.586793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:15.587498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:15.587835 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:15.588108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:15.596944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:15.598405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:15.607661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1061/2105] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:15 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:16.022810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:16.025572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:16.041473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07252886-cb31-4abb-9bbd-ea8d1a767c91 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:16.047594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:16.048410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.048795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.049168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] PATH_INFO: `/v3/projects/2537235d2e5c44ff876f1c6243143bc2` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.050736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2537235d2e5c44ff876f1c6243143bc2)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:16.053312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:16.135097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2537235d2e5c44ff876f1c6243143bc2', 'request_id': 'req-0fc69777-d134-4c65-994f-fc21fb9a2775'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.140890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2537235d2e5c44ff876f1c6243143bc2', 'request_id': 'req-0fc69777-d134-4c65-994f-fc21fb9a2775'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.146765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2537235d2e5c44ff876f1c6243143bc2', 'request_id': 'req-0fc69777-d134-4c65-994f-fc21fb9a2775'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.160862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] The token cache is being invalidate because project 2537235d2e5c44ff876f1c6243143bc2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:16.161218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.161938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.163526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1045/2106] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:16 2022] DELETE /identity/v3/projects/2537235d2e5c44ff876f1c6243143bc2 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:16.167672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:16.178888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17728fc9-9196-43ed-8a3a-d255c12b724a service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:16.251247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:16.253089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.253089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.253089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] PATH_INFO: `/v3/users/d18b2b4a734342f6a377b01fdb65ced6` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.253723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d18b2b4a734342f6a377b01fdb65ced6)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:16.256293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:16.312978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd18b2b4a734342f6a377b01fdb65ced6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.313758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd18b2b4a734342f6a377b01fdb65ced6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.314298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd18b2b4a734342f6a377b01fdb65ced6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.321817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd18b2b4a734342f6a377b01fdb65ced6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.337729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ed6d993c-fc8b-4d7f-ac8b-69d37a9e7654 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd18b2b4a734342f6a377b01fdb65ced6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.352288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1062/2107] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:16 2022] DELETE /identity/v3/users/d18b2b4a734342f6a377b01fdb65ced6 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:16.644173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:16.646578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:16.660979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc69777-d134-4c65-994f-fc21fb9a2775 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:16.717845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:16.718507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.718786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.719060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] PATH_INFO: `/v3/projects/df483a6b7e144c878e99d58367338e45` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.720227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df483a6b7e144c878e99d58367338e45)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:16.722629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:16.769544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df483a6b7e144c878e99d58367338e45', 'request_id': 'req-08ed8713-a348-46c0-9609-32edca8d5152'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.775721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df483a6b7e144c878e99d58367338e45', 'request_id': 'req-08ed8713-a348-46c0-9609-32edca8d5152'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.781663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df483a6b7e144c878e99d58367338e45', 'request_id': 'req-08ed8713-a348-46c0-9609-32edca8d5152'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.783452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:16.795854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] The token cache is being invalidate because project df483a6b7e144c878e99d58367338e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:16.796330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.797276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-08ed8713-a348-46c0-9609-32edca8d5152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:16.798795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1046/2108] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:16 2022] DELETE /identity/v3/projects/df483a6b7e144c878e99d58367338e45 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:16.805477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.805976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.806151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.826072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:16.827206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:16.844170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:16.887169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1063/2109] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:16.895288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.895574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.895920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.915261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:16.916518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:16.924540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1047/2110] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:16.929360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:16.939127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1dcb5-567d-484c-b338-a0711b4ccb08 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:16.944955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:16.946033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.946448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.946897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.948119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:16.948563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:16.950205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:16.962111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1064/2111] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:16.966471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:16.976270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d324268-d5c8-4489-8169-c1cf9d532a89 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:16.981229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:16.981831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:16.982110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:16.982383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:16.983016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:16.984972 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.012428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1048/2112] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:16 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:17.016879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:17.026689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a893a70-c164-4b2d-ad44-c910a5d1e91a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:17.083894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:17.084439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.084719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.084994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.085622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:17.087525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.114388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1065/2113] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:17 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:17.116217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:17.142097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797e4cd2-2d90-417f-aaa1-8f960dda3420 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:17.147244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:17.147886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.148150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.148427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.149068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:17.150940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.179423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1049/2114] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:17.183396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:17.198377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0465f9b-2742-4da5-917e-d17f74ef784e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:17.218163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:17.219115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.219587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.220018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.221015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:17.224090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b095df1-5a24-4d50-b6ad-309161828932 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.239234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1066/2115] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:17 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:17.243429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:17.254689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f5dc5-2074-4339-83d4-2c5c0a8eee40 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:17.260145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:17.260964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.261343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.261714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] PATH_INFO: `/v3/projects/b5636ebbd2eb47678ce710522c268197/users/6982e25630b1420fb8fdecbf2df598cf/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.285801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5636ebbd2eb47678ce710522c268197, user_id=6982e25630b1420fb8fdecbf2df598cf, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:17.289003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.307814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1050/2116] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:17 2022] PUT /identity/v3/projects/b5636ebbd2eb47678ce710522c268197/users/6982e25630b1420fb8fdecbf2df598cf/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:17.321065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.321349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.321604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.352247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] MFA Rules not processed for user `6982e25630b1420fb8fdecbf2df598cf`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:17.353417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:17.423160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1067/2117] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:17.447280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:17.449122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:17.543441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d2c95a-62d8-4d4f-ae48-aea35dc4f497 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:17.549737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:17.550465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:17.550766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:17.551037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:17.565579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:17.567979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e2cc97-a28a-48a5-a471-75ea6d3adb3d service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:17.584193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1051/2118] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:18.298537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:18.300046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:18.320418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:18.370042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08340b9e-6bb7-480f-817f-d3124a404c1f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:18.374553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:18.375705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:18.376009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:18.376313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] PATH_INFO: `/v3/users/1b24d7081add4b69befea78b90ca76a5` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:18.378023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b24d7081add4b69befea78b90ca76a5)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:18.382249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:18.448389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b24d7081add4b69befea78b90ca76a5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:18.449043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b24d7081add4b69befea78b90ca76a5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:18.449637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b24d7081add4b69befea78b90ca76a5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:18.457667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b24d7081add4b69befea78b90ca76a5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:18.471627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b24d7081add4b69befea78b90ca76a5'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:18.487112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1068/2119] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:18 2022] DELETE /identity/v3/users/1b24d7081add4b69befea78b90ca76a5 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:18.492431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:18.492431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:18.492970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:18.512413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:18.513616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:18.619880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1052/2120] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:18.632286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:18.634015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:18.754542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad263896-c1be-4f7e-9e8a-24b481535540 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:18.765028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:18.765670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:18.765947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:18.766220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:18.778129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:18.779611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:18.790787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1069/2121] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:19.278055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:19.279457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:19.302335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95592d9-39e4-4ce6-b826-8439caa49c60 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:19.314209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:19.315560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:19.315977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:19.345480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] PATH_INFO: `/v3/projects/d85578836f2b4734a3355c47bc796891` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:19.347378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d85578836f2b4734a3355c47bc796891)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:19.355821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:19.444590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=3,keystone:DELETE=2,keystone:SELECT=95 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:19.469613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd85578836f2b4734a3355c47bc796891', 'request_id': 'req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:19.477728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd85578836f2b4734a3355c47bc796891', 'request_id': 'req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:19.483189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd85578836f2b4734a3355c47bc796891', 'request_id': 'req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:19.500833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] The token cache is being invalidate because project d85578836f2b4734a3355c47bc796891 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:19.501836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:19.501836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-abcdc61d-d6a7-4cd3-a8e0-cc2f5ec69ac8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:19.503424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1053/2122] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:19 2022] DELETE /identity/v3/projects/d85578836f2b4734a3355c47bc796891 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:23.581875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:23.583434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:23.596505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378cc472-3c8c-4f11-9b1b-278dcf836f5b service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:23.636430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:23.657455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:23.658099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:23.658404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:23.658673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] PATH_INFO: `/v3/users/01ca8e434a554f7dac21af41ae1d9fb7` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:23.659930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01ca8e434a554f7dac21af41ae1d9fb7)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:23.662077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:23.719707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01ca8e434a554f7dac21af41ae1d9fb7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:23.720437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01ca8e434a554f7dac21af41ae1d9fb7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:23.721053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01ca8e434a554f7dac21af41ae1d9fb7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:23.729167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01ca8e434a554f7dac21af41ae1d9fb7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:23.743049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01ca8e434a554f7dac21af41ae1d9fb7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:23.761900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1070/2123] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:23 2022] DELETE /identity/v3/users/01ca8e434a554f7dac21af41ae1d9fb7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:23.767081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:23.767987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:23.768483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:23.792790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:23.794044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:23.861412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1054/2124] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:23.871797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:23.873330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:23.938010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc348cd1-640e-47cd-84b3-4aa26cdcc682 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:23.941943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:23.942585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:23.942867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:23.943144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:23.953263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:23.954756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:23.964633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1071/2125] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:24.321010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:24.322648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:24.342450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca8e7bb-5f07-47f4-8e37-96d512110de4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:24.352185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:24.356060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:24.356875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:24.361741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] PATH_INFO: `/v3/projects/b444ee390d064e45b688e83c65cd6599` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:24.363382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b444ee390d064e45b688e83c65cd6599)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:24.365363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:24.514588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b444ee390d064e45b688e83c65cd6599', 'request_id': 'req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.536709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b444ee390d064e45b688e83c65cd6599', 'request_id': 'req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.550130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b444ee390d064e45b688e83c65cd6599', 'request_id': 'req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.575101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] The token cache is being invalidate because project b444ee390d064e45b688e83c65cd6599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:24.575459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.576700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.578124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1055/2126] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:24 2022] DELETE /identity/v3/projects/b444ee390d064e45b688e83c65cd6599 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:24.583197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:24.597099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26edc110-14a9-471a-977b-ef7be285773c service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:24.751420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:24.751420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:24.751420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:24.751854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] PATH_INFO: `/v3/users/267a573107824dc58bc4c26619a259e9` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:24.752693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=267a573107824dc58bc4c26619a259e9)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:24.755310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:24.758130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:24.824314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '267a573107824dc58bc4c26619a259e9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.825712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '267a573107824dc58bc4c26619a259e9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.826264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '267a573107824dc58bc4c26619a259e9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.835107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '267a573107824dc58bc4c26619a259e9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.849877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c89c2a82-c7d9-4a51-8814-4f0661727b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '267a573107824dc58bc4c26619a259e9'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:24.867462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1072/2127] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:24 2022] DELETE /identity/v3/users/267a573107824dc58bc4c26619a259e9 => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:25.329967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:25.331435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:25.370059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5d6b1f-4adb-4a66-9e58-566c5e70da63 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:25.405002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:25.433967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:25.434897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.435175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.435976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] PATH_INFO: `/v3/projects/8eeaa66c37e4451996ba811c2158b150` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.437398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eeaa66c37e4451996ba811c2158b150)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:25.439549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:25.496178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eeaa66c37e4451996ba811c2158b150', 'request_id': 'req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:25.502767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eeaa66c37e4451996ba811c2158b150', 'request_id': 'req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:25.508869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eeaa66c37e4451996ba811c2158b150', 'request_id': 'req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:25.526167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] The token cache is being invalidate because project 8eeaa66c37e4451996ba811c2158b150 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:25.526265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:25.526906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cb428a2a-d1ba-4a87-87c3-8ad81ed44f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:25.528646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1056/2128] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:25 2022] DELETE /identity/v3/projects/8eeaa66c37e4451996ba811c2158b150 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:25.533357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.534240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.534240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.559497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:25.560503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:25.630811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1073/2129] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:25.640530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.640628 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.641379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.682424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:25.683811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:25.699046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:25.704261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1057/2130] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:25.711580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c532b5-46af-4fbb-be81-bddd95abe3ea None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:25.728620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:25.729339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.729849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.730300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.731139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:25.731530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:25.733661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:25.756783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1074/2131] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:25.761852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:25.773755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce4433e-f488-4db7-b638-c19a8e812ce3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:25.778794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:25.779662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.779662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.779960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.780604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:25.783259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:25.823755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1058/2132] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:25 2022] POST /identity/v3/projects => generated 401 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:25.828233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:25.840482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca62ad3-6473-4608-8e55-e0468888b784 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:25.978864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:25.980659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:25.981118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:25.981909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:25.982769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:25.985589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.008145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:26.024483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1075/2133] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:25 2022] POST /identity/v3/users => generated 301 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:26.026753 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.057996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5734c81-9cd7-4d1a-8ec6-e9771c404971 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.064582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.065418 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.065779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.067087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.068620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.072959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.114281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1059/2134] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:26.115696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.130205 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefd0b83-27a9-46c1-a2d9-5e0dea975563 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.135253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.135926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.138039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.138039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.138039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.140442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab501a-393f-40f5-a7f3-7f0f9f2e89fb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.155498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1076/2135] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:26.160737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.174671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ab389-2355-4ea3-83f4-da45c939e7b5 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.180939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.181930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.182400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.182862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] PATH_INFO: `/v3/projects/0ef2e24ff0c34bd5be0e7ea86b46608d/users/df0a4620375d48b4a08c456d5187ad7b/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.204976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0ef2e24ff0c34bd5be0e7ea86b46608d, user_id=df0a4620375d48b4a08c456d5187ad7b, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.208283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.222401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1060/2136] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:26 2022] PUT /identity/v3/projects/0ef2e24ff0c34bd5be0e7ea86b46608d/users/df0a4620375d48b4a08c456d5187ad7b/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:26.233030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.233318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.233619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.267128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] MFA Rules not processed for user `df0a4620375d48b4a08c456d5187ad7b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:26.270246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:26.351197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1077/2137] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:26.355447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.442230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d499951b-4b21-4dc6-92dd-dc7fcbf4803f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.449623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.450432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.450713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.450983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.451820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.453745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.465548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:26.491811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1061/2138] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:26 2022] POST /identity/v3/projects => generated 401 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:26.494094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.506269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc2b8f1-76a6-4b2b-8222-d3cdfa990792 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.570420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.571153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.571501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.571881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.572516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.574435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.595115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1078/2139] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:26 2022] POST /identity/v3/users => generated 307 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:26.599125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.609429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2974ee28-3570-4fa3-bbb1-aa779f1ef092 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.614616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.615224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.615504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.615796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.616465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.618047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.632045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1062/2140] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:26.633177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.643568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad213b8-2eff-493a-baaf-56c8f0d8de45 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.649132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.650005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.650427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.650931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] PATH_INFO: `/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592/users/9d4d0c2bad7a44ca84a88e676f65ce43/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.666808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbb7d216d824ddfa8f6f573ecc7b592, user_id=9d4d0c2bad7a44ca84a88e676f65ce43, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.669457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.692534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1079/2141] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:26 2022] PUT /identity/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592/users/9d4d0c2bad7a44ca84a88e676f65ce43/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:26.696406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.702463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.704239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:26.707010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091fc8d2-3efe-494f-a265-a6b1285d748c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.762985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:26.777578 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.778134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.778437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.778696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.779345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.780999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d166a1-90ae-4dff-8e73-0e1b57481c35 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.788090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2192d88b-d25c-43fe-9c33-ee36a21b2c22 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.797183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1063/2142] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:26 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:26.797183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33445d7-fe1c-49af-b4e8-0dd4358ce4bd None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.797183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33445d7-fe1c-49af-b4e8-0dd4358ce4bd None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.797183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33445d7-fe1c-49af-b4e8-0dd4358ce4bd None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.798418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.799124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.799399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.799712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] PATH_INFO: `/v3/users/a57754413a924b878ad6332f1225534d` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.801499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a57754413a924b878ad6332f1225534d)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.803434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.804016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1064/2143] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:53:26 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:53:26.805617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33445d7-fe1c-49af-b4e8-0dd4358ce4bd None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.821441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33445d7-fe1c-49af-b4e8-0dd4358ce4bd None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.825942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.826625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.826912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.827193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] PATH_INFO: `/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592/users/9d4d0c2bad7a44ca84a88e676f65ce43/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.829971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dfbb7d216d824ddfa8f6f573ecc7b592, user_id=9d4d0c2bad7a44ca84a88e676f65ce43, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.832827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba1ec65-64eb-4fa8-98a4-c0700f715c62 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:26.845488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1065/2144] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:26 2022] PUT /identity/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592/users/9d4d0c2bad7a44ca84a88e676f65ce43/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:26.846821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60ab6-5bda-4fd7-8708-76bf024b6855 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.847915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60ab6-5bda-4fd7-8708-76bf024b6855 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.848122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e60ab6-5bda-4fd7-8708-76bf024b6855 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.858748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a57754413a924b878ad6332f1225534d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:26.859470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a57754413a924b878ad6332f1225534d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:26.860885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a57754413a924b878ad6332f1225534d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:26.867910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a57754413a924b878ad6332f1225534d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:26.871580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a6e60ab6-5bda-4fd7-8708-76bf024b6855 None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:26.872818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a6e60ab6-5bda-4fd7-8708-76bf024b6855 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:26.880265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a57754413a924b878ad6332f1225534d'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:26.894869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1080/2145] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:26 2022] DELETE /identity/v3/users/a57754413a924b878ad6332f1225534d => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:26.898023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:26.898023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:26.940726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1066/2146] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:26.942363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca6a0-c42f-4b46-aed7-716c8905bbed None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.942655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca6a0-c42f-4b46-aed7-716c8905bbed None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.942965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccca6a0-c42f-4b46-aed7-716c8905bbed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.964262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a627b9-6f65-4e2f-a7f4-a6a5b28798c3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:26.968910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:26.969543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:26.970403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:26.970702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] PATH_INFO: `/v3/users/3856f43e563a474d869fd7eceb8c53a4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:26.972977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-0ccca6a0-c42f-4b46-aed7-716c8905bbed None None] MFA Rules not processed for user `9d4d0c2bad7a44ca84a88e676f65ce43`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:26.973107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3856f43e563a474d869fd7eceb8c53a4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:26.973942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0ccca6a0-c42f-4b46-aed7-716c8905bbed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:26.977132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.029458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:27.037279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3856f43e563a474d869fd7eceb8c53a4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.037973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3856f43e563a474d869fd7eceb8c53a4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.038651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3856f43e563a474d869fd7eceb8c53a4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.046174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3856f43e563a474d869fd7eceb8c53a4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.053110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:27.065457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3856f43e563a474d869fd7eceb8c53a4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.070055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1067/2147] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:26 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:27.073411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.073906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.074962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.085389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1081/2148] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:26 2022] DELETE /identity/v3/users/3856f43e563a474d869fd7eceb8c53a4 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:27.086535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.089620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.099594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:27.100744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.218487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadc64a6-0339-4f2c-9a4a-14062b058639 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.221010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1068/2149] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:27.226940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.228611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.228898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.230006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.230520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.231152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.233738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.247883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.250479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.262898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1082/2150] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:27.277467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.279951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.303665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107e1033-6549-42fc-b57b-ae42f39c4c44 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.309723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.310967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.311250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.311520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.361232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd77bb8-c943-4a14-b103-41c49220be74 service placement] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.365431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.366103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.366315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.366590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.383406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.386346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.398350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1083/2151] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:27.399274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.401177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.418623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca840f8e-7f8f-4f5f-90fe-a9b3059ad20d service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.427623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.427814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.429293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.430447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.430720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.431008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] PATH_INFO: `/v3/projects/9e7fa76656c24226a3f5787412b5b38a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.432262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e7fa76656c24226a3f5787412b5b38a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.434552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.441506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1069/2152] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:27.554179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e7fa76656c24226a3f5787412b5b38a', 'request_id': 'req-28342cb9-3268-49d3-96da-b4263491f50f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.560175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.563182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e7fa76656c24226a3f5787412b5b38a', 'request_id': 'req-28342cb9-3268-49d3-96da-b4263491f50f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.569868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a8ae3d5-6d67-46d5-a207-0433d6b79f40 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.585357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e7fa76656c24226a3f5787412b5b38a', 'request_id': 'req-28342cb9-3268-49d3-96da-b4263491f50f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.590743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:27.603284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] The token cache is being invalidate because project 9e7fa76656c24226a3f5787412b5b38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:27.604214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.604832 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-28342cb9-3268-49d3-96da-b4263491f50f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:27.607288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1084/2153] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:27 2022] DELETE /identity/v3/projects/9e7fa76656c24226a3f5787412b5b38a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:27.613228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:27.614466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e1b0-cd7a-433c-9a95-da918f3f51dd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.614909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e1b0-cd7a-433c-9a95-da918f3f51dd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.615564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7920e1b0-cd7a-433c-9a95-da918f3f51dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.642415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7920e1b0-cd7a-433c-9a95-da918f3f51dd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:27.644676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7920e1b0-cd7a-433c-9a95-da918f3f51dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.649455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.650416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.650888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.651383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.653986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.730082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1085/2154] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:27.731477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.731840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.732178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.740928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.742791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.753108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1070/2155] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:27 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:27.757003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:27.759112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.772597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1086/2156] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:27.774682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.787500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba51ba-f352-4077-8b92-f6b945273536 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.793158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.794521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.794878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.795365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.796258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:27.796775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.798516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.819899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1071/2157] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:27.821379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.834070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e09407b-e198-49f3-89a8-bf78cc5ce6ae None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.839901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.842283 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.842728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.843675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.844514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.846435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.877713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1087/2158] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:27 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:27.882327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.896203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b381fa4-edc0-4864-9031-d8187c098586 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:27.974136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:27.975023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:27.975580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:27.976232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:27.977092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:27.977490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:27.979190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:27.979685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:27.996901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f19c850-3e3a-4a53-bade-566ee3504be2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.004599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.013749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1072/2159] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:27 2022] POST /identity/v3/users => generated 288 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:28.015072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.015405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.015689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] PATH_INFO: `/v3/projects/1dc94575ef3a46a5a4ee7774d770142f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.017998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.019236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dc94575ef3a46a5a4ee7774d770142f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.021896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.039169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408577bb-b6e7-498d-b09c-e0209f81da52 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.044697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.045474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.045646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.047551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.047551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.049423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.091816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1073/2160] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:28.093354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.098173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dc94575ef3a46a5a4ee7774d770142f', 'request_id': 'req-215a7433-eecf-43ec-9c51-683532bca323'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:28.112290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaeafc88-533e-485d-b054-32ee226c7ef8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.114141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dc94575ef3a46a5a4ee7774d770142f', 'request_id': 'req-215a7433-eecf-43ec-9c51-683532bca323'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:28.122281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dc94575ef3a46a5a4ee7774d770142f', 'request_id': 'req-215a7433-eecf-43ec-9c51-683532bca323'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:28.134679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] The token cache is being invalidate because project 1dc94575ef3a46a5a4ee7774d770142f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:28.134977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:28.135680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-215a7433-eecf-43ec-9c51-683532bca323 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:28.140843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1088/2161] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:27 2022] DELETE /identity/v3/projects/1dc94575ef3a46a5a4ee7774d770142f => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:28.142263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7ebf-b616-4aff-ae77-64ebf1fd1ca5 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.142544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7ebf-b616-4aff-ae77-64ebf1fd1ca5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.142823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190b7ebf-b616-4aff-ae77-64ebf1fd1ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.162870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-190b7ebf-b616-4aff-ae77-64ebf1fd1ca5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:28.164211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-190b7ebf-b616-4aff-ae77-64ebf1fd1ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.167223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:28.179694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.180450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.180800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.181156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.181866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.184028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.194342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1074/2162] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:28.198537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.200314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.213720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440eef5-b5da-4118-8106-d2b1850fbbc0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.214101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:28.220724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.221584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.221908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.222092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] PATH_INFO: `/v3/projects/cefe4027041d4b7ea9939c687c2b372a/users/b94077b7a43c42b68f633afe3c9ce715/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.235435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1089/2163] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:28.239176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cefe4027041d4b7ea9939c687c2b372a, user_id=b94077b7a43c42b68f633afe3c9ce715, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.241854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fda87-7382-436a-bd58-91f159580dc0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.244078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.244480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.244688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.260173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1075/2164] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:28 2022] PUT /identity/v3/projects/cefe4027041d4b7ea9939c687c2b372a/users/b94077b7a43c42b68f633afe3c9ce715/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:28.269247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.269635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.270009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.271229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:28.272489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.294597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:28.296059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.338148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1090/2165] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:28.341955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.354982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382c2eb0-1377-47ea-913b-4907192d4d8d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.361069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.361671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.361947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.362212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.363532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:28.363908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.365969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1076/2166] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:28.366091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.378811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.380256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.381711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1091/2167] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:53:28.382260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.392737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4d8e32-edb6-4a8f-b0d0-69c4a434fd53 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.397689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.398366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.398784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.399115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.399849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.402677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.431690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1092/2168] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/projects => generated 383 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:28.435659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.454846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974f80e7-03e4-4284-ad0a-25cabf3d10d1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.506493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dac49ae-1139-465a-96fe-79c39fca8ea9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.511163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.511790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.512072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.512344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.512436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.512977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.513095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.513295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.513561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.515197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.523120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.524561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.536297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1077/2169] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:28.537736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1093/2170] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:28.541584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.551886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d2e10c-5183-46fc-a26e-16ef7055fb17 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.556699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.557286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.557629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.557959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.558632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.560483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.571272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1078/2171] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:28.575239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.585485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb3dba0-f2c1-496e-9304-dd3b1596aace admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.590095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.590689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.591408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.591408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.591886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.593480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ee3cf6-1fef-42ef-b64d-ffb8478584bb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.607420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1094/2172] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:28.609133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.620519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ddc63-fe16-46d8-a648-735f7d44915a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.625336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.625996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.626293 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.626618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] PATH_INFO: `/v3/projects/ecd17dd4fa104a0f9e276cd7820dd140/users/b639c5b532cc4267b39b643ead162c14/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.638510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:28.643705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=ecd17dd4fa104a0f9e276cd7820dd140, user_id=b639c5b532cc4267b39b643ead162c14, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.647228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.663803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1079/2173] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:28 2022] PUT /identity/v3/projects/ecd17dd4fa104a0f9e276cd7820dd140/users/b639c5b532cc4267b39b643ead162c14/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:28.668068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcc85-b76c-4fd2-a557-6b32e9f0d61b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.668523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcc85-b76c-4fd2-a557-6b32e9f0d61b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.668703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357bcc85-b76c-4fd2-a557-6b32e9f0d61b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.695508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-357bcc85-b76c-4fd2-a557-6b32e9f0d61b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:28.697668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-357bcc85-b76c-4fd2-a557-6b32e9f0d61b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.752933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:28.795638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1095/2174] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:28.804537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:28.806312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:28.873170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878da0a2-68ac-4f2f-962b-db774bb6e4ad admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:28.878013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:28.878791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:28.879129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:28.879466 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:28.891766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:28.892988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:28.904276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1080/2175] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 04:53:30.178254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:30.178786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:30.178786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:30.229766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] MFA Rules not processed for user `b639c5b532cc4267b39b643ead162c14`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:30.232586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:30.345296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1096/2176] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:30.353324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:30.358671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:30.473471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2221f93f-0590-4c26-8f38-093d0963f1d4 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:30.502277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:30.502988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:30.504167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:30.504926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:30.531328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:30.534336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94a6c36-380a-4ef0-8c6c-3ff14256fb4d service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:30.558154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1081/2177] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:30 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:32.157487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:32.160011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:32.185886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4c099-eb4d-4322-b445-f04e40e8837e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:32.197346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:32.198356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:32.198843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:32.199418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] PATH_INFO: `/v3/users/df0a4620375d48b4a08c456d5187ad7b` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:32.201926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576790ab-ee7e-4e4b-846e-a97ea12ea0d2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:32.202786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576790ab-ee7e-4e4b-846e-a97ea12ea0d2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:32.203211 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-576790ab-ee7e-4e4b-846e-a97ea12ea0d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:32.213588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df0a4620375d48b4a08c456d5187ad7b)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:32.224410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:32.239661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-576790ab-ee7e-4e4b-846e-a97ea12ea0d2 None None] MFA Rules not processed for user `b639c5b532cc4267b39b643ead162c14`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:32.241241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-576790ab-ee7e-4e4b-846e-a97ea12ea0d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:32.249359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1082/2178] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:32 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:32.328227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df0a4620375d48b4a08c456d5187ad7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:32.329814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df0a4620375d48b4a08c456d5187ad7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:32.330645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df0a4620375d48b4a08c456d5187ad7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:32.347287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df0a4620375d48b4a08c456d5187ad7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:32.372765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df0a4620375d48b4a08c456d5187ad7b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:32.399236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1097/2179] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:32 2022] DELETE /identity/v3/users/df0a4620375d48b4a08c456d5187ad7b => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:32.403639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:32.403948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:32.404227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:32.442760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:32.444042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:32.538603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1083/2180] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:32.556821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:32.559127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:32.692652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:32.726881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead0e1df-42e6-43a8-9db5-1f67db958b2b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:32.748878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:32.749534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:32.749814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:32.750082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:32.792420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:32.794016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:32.824158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1098/2181] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:33.681673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:33.683887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:33.712148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11956e84-aebb-41df-af86-205be02ab2d0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:33.719398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:33.720391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:33.720890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:33.721361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] PATH_INFO: `/v3/projects/0ef2e24ff0c34bd5be0e7ea86b46608d` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:33.723204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0ef2e24ff0c34bd5be0e7ea86b46608d)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:33.726417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:33.773454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=98,keystone:INSERT=1,keystone:DELETE=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:33.831148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0ef2e24ff0c34bd5be0e7ea86b46608d', 'request_id': 'req-5a898582-e0b3-4361-b4e2-4eaa96ff615b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:33.842569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:33.843931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0ef2e24ff0c34bd5be0e7ea86b46608d', 'request_id': 'req-5a898582-e0b3-4361-b4e2-4eaa96ff615b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:33.844569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:33.854869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0ef2e24ff0c34bd5be0e7ea86b46608d', 'request_id': 'req-5a898582-e0b3-4361-b4e2-4eaa96ff615b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:33.868337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf37e93-5c9d-431e-b782-8937626ea3c7 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:33.886558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] The token cache is being invalidate because project 0ef2e24ff0c34bd5be0e7ea86b46608d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:33.886848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:33.890807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:33.897246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1084/2182] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:33 2022] DELETE /identity/v3/projects/0ef2e24ff0c34bd5be0e7ea86b46608d => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:33.898477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:33.905913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:34.059779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:34.060443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.060718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.061143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] PATH_INFO: `/v3/users/6982e25630b1420fb8fdecbf2df598cf` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.062877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] RBAC: Authorizing `identity:delete_user(user_id=6982e25630b1420fb8fdecbf2df598cf)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:34.066304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:34.088479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a898582-e0b3-4361-b4e2-4eaa96ff615b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:34.104410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:34.106321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.108401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.108917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] PATH_INFO: `/v3/users/9d4d0c2bad7a44ca84a88e676f65ce43` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.116167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d4d0c2bad7a44ca84a88e676f65ce43)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:34.118821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:34.182144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6982e25630b1420fb8fdecbf2df598cf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.183171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6982e25630b1420fb8fdecbf2df598cf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.183986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6982e25630b1420fb8fdecbf2df598cf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.229265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d4d0c2bad7a44ca84a88e676f65ce43'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.230482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d4d0c2bad7a44ca84a88e676f65ce43'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.231795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d4d0c2bad7a44ca84a88e676f65ce43'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.248219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6982e25630b1420fb8fdecbf2df598cf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.266153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d4d0c2bad7a44ca84a88e676f65ce43'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.273430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-be2bec89-6da0-42d1-a547-6e1c1220759d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6982e25630b1420fb8fdecbf2df598cf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.276586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-28719414-5287-4187-bb07-c18a4f9ca945 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d4d0c2bad7a44ca84a88e676f65ce43'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:34.312027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1099/2183] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:33 2022] DELETE /identity/v3/users/6982e25630b1420fb8fdecbf2df598cf => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:34.316660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.316933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.317218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.327552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1085/2184] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:33 2022] DELETE /identity/v3/users/9d4d0c2bad7a44ca84a88e676f65ce43 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:34.329511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.329947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.330678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.356707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:34.358504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:34.361824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] MFA Rules not processed for user `b94077b7a43c42b68f633afe3c9ce715`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:34.363134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:34.405694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:34.463316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:34.498448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1100/2185] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:34.515674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1086/2186] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:34.521077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:34.522676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:34.590821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:34.593127 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:34.703117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ddcda0-478a-4375-b34f-5d1103711841 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:34.711946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ceff2c-169e-43f5-9cf1-8fe5489bd0b0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:34.717256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:34.717904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.718184 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.718457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.725841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:34.726356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:34.726667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:34.726960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:34.745985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:34.747965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:34.752580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:34.760818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6eb7d07-52dd-4a88-a268-2e6472935ebd service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:34.770890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1101/2187] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 255 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:34.795272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1087/2188] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:35.021501 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.023197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.044967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c62f32f-9e3b-4796-83f6-8a67b5d1345c service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.062622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.063211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.063505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.063810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] PATH_INFO: `/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.068925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dfbb7d216d824ddfa8f6f573ecc7b592)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.071146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.189933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dfbb7d216d824ddfa8f6f573ecc7b592', 'request_id': 'req-93fb9eca-1227-40ba-90d3-526614786cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.212435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dfbb7d216d824ddfa8f6f573ecc7b592', 'request_id': 'req-93fb9eca-1227-40ba-90d3-526614786cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.220503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dfbb7d216d824ddfa8f6f573ecc7b592', 'request_id': 'req-93fb9eca-1227-40ba-90d3-526614786cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.234043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] The token cache is being invalidate because project dfbb7d216d824ddfa8f6f573ecc7b592 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:35.234343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.235018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-93fb9eca-1227-40ba-90d3-526614786cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.240354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1102/2189] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:35 2022] DELETE /identity/v3/projects/dfbb7d216d824ddfa8f6f573ecc7b592 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:35.242970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.243526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.244035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.275959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:35.277286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.373732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1088/2190] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:35.383220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.384174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.384460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.384698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.384802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.414952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a746c38c-c4d0-46cd-87f7-96486041f1e5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.423570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.424493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.424775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.426278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] PATH_INFO: `/v3/projects/b5636ebbd2eb47678ce710522c268197` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.427712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5636ebbd2eb47678ce710522c268197)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.437062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.445492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:35.449559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.475032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1103/2191] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:35.476394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.497356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696511fc-d166-4c1a-a8da-7fa46feaa853 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.511697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.513272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.514265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.514265 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.515216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:35.515633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.522833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.539443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1104/2192] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:53:35.543844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.549733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5636ebbd2eb47678ce710522c268197', 'request_id': 'req-54d8222f-2a38-4764-b4fc-894ab65305dd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.560299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5636ebbd2eb47678ce710522c268197', 'request_id': 'req-54d8222f-2a38-4764-b4fc-894ab65305dd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.562352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695498b1-0286-4c00-8700-f0ae57a9a934 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.568447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5636ebbd2eb47678ce710522c268197', 'request_id': 'req-54d8222f-2a38-4764-b4fc-894ab65305dd'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.584764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:35.606175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] The token cache is being invalidate because project b5636ebbd2eb47678ce710522c268197 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:35.608046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.609204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-54d8222f-2a38-4764-b4fc-894ab65305dd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:35.612415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1089/2193] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:35 2022] DELETE /identity/v3/projects/b5636ebbd2eb47678ce710522c268197 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:35.618630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be626-f93d-47a8-863d-6c55ef538193 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.619055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be626-f93d-47a8-863d-6c55ef538193 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.619336 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04be626-f93d-47a8-863d-6c55ef538193 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.632890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:35.657568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e04be626-f93d-47a8-863d-6c55ef538193 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:35.660266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e04be626-f93d-47a8-863d-6c55ef538193 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.681082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.681803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.682146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.682658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.683396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.685824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.724039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1105/2194] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/projects => generated 387 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:35.725221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.727476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.782359 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1090/2195] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:35.791673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.791995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.792732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.820151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af70e9e-d3f6-41f5-8ec4-ac094db4bc6e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.825527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.826219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.826566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.826912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.827630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.830755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.837261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:35.840666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:35.855767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1091/2196] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:35.858221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.871482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1106/2197] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:35.877657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.892426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb65cd4-6f4f-48f9-b783-4cc433e9d07a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.900976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c72eee-dffc-4945-9c51-ae902c1e5cab admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.906844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.907626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.909661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.910690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.911029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.911570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.912383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:35.912691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.915550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.918777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.919123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.920321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.921953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.938451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1092/2198] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:35.938646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1107/2199] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:35.941786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.945362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:35.954520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f5eecd-1e4f-4e5f-b931-8899150e8eec admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.967225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96cad2d2-16dd-4252-adf5-252d9f6b8c64 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:35.978436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.981273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.982519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.982826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.983506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:35.984220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:35.984500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:35.985810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.985947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:35.986405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:35.990263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:35.990400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.015694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1108/2200] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:35 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:36.017857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.038148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edc204-d9bb-4fda-9d74-8b7f1618efec admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.046911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.048060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.048635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.049099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] PATH_INFO: `/v3/projects/2675c89ae5f4473f859841d44473e0d0/users/6e1e45ed5d854aa4bbf53e7d5370af8f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.078739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2675c89ae5f4473f859841d44473e0d0, user_id=6e1e45ed5d854aa4bbf53e7d5370af8f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.086046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1093/2201] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:35 2022] POST /identity/v3/projects => generated 391 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:36.087269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.091997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7397ff55-2285-416e-9a8e-afd2dd9fae12 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.146238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1109/2202] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:36 2022] PUT /identity/v3/projects/2675c89ae5f4473f859841d44473e0d0/users/6e1e45ed5d854aa4bbf53e7d5370af8f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:36.158712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.159026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.159769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.232254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] MFA Rules not processed for user `6e1e45ed5d854aa4bbf53e7d5370af8f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:36.233409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:36.262580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae31b7c-172d-4fc8-9c88-6cfd056a5619 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.306421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:36.349330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1110/2203] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:36.351918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.377492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.378693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.379012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.379335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.380107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.382496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.398587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:36.430501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1094/2204] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:36 2022] POST /identity/v3/users => generated 296 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:36.439575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.455393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dbf7b46-cd31-4e7d-9297-33abaa8b67e7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.460703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.461461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.462136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.462508 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.463489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.464405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d5163b-52a5-474d-9d36-d4fa57b1644d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.465525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.471580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.472180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.472465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.472740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.473974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.481067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1095/2205] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:36.488907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.489100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.504745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f93938b-edee-4476-b5cd-fc8984f3890e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.512495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.513244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.513555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.513868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.515140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.517159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.532865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1111/2206] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:36 2022] POST /identity/v3/projects => generated 387 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:36.533543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1096/2207] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:36.536695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.538183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.553103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53ac56b-60db-4c7e-95fe-0e7822b78755 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.629011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.629874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.630217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.630557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] PATH_INFO: `/v3/projects/c8b44fb6662045138e0e077c5f7704f8/users/37091762784749e487668352331e8c5f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.649343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d00096-d9e9-4932-b1be-8a4f9fcd3a12 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.649794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8b44fb6662045138e0e077c5f7704f8, user_id=37091762784749e487668352331e8c5f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.653422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c00417-3c4a-43a0-9d8f-9f71d316c881 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.654396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.655017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.655294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.655567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.656230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.659887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.693102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1097/2208] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:36 2022] PUT /identity/v3/projects/c8b44fb6662045138e0e077c5f7704f8/users/37091762784749e487668352331e8c5f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:36.697037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.697781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.699292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.715622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1112/2209] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:36 2022] POST /identity/v3/users => generated 300 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:36.719875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.731718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a80b750-e8dc-40e3-b472-74531bc213ce admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.741571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] MFA Rules not processed for user `37091762784749e487668352331e8c5f`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:36.743903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:36.831281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.832850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.833322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.833785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.834514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.837607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.851964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1113/2210] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 132 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:36.853784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1098/2211] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:36 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:36.857991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.868121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.869915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:36.874502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf45ad2-abf9-4e21-99a5-02cebca46ff8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:36.882597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:36.883570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:36.883984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:36.884359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] PATH_INFO: `/v3/projects/0493dbd6e43d4f4592b4004e7823225d/users/a4f040bc4ea74fcfa2605b91d7dc94ff/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:36.887154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:36.908705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0493dbd6e43d4f4592b4004e7823225d, user_id=a4f040bc4ea74fcfa2605b91d7dc94ff, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:36.913107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:36.940764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1114/2212] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:36 2022] PUT /identity/v3/projects/0493dbd6e43d4f4592b4004e7823225d/users/a4f040bc4ea74fcfa2605b91d7dc94ff/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:36.941896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:36.978249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:36.998135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548b1c5e-bef5-496d-b62f-129a93fb4e73 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:37.038069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e11ba09-79ba-47a5-911d-161cb88149e4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:37.042831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:37.043490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.043700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.043998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.044628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:37.046362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6615e0d4-5f20-40c9-80b8-63c783428afd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:37.058062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1115/2213] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:36 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:37.059476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.059866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.060348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.073950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:37.075849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.075849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.075849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.084379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] MFA Rules not processed for user `b94077b7a43c42b68f633afe3c9ce715`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:37.086582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:37.153620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:37.155677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-625bdea2-1dac-4aaa-a640-a2f80a9eaa70 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:37.163772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1116/2214] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:37.163772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:37.180318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6436f03-4f17-479e-959d-c7e1893ed861 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:37.189981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1099/2215] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:37.192234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:37.192608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.192987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.193383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] PATH_INFO: `/v3/projects/0493dbd6e43d4f4592b4004e7823225d/users/a4f040bc4ea74fcfa2605b91d7dc94ff/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.195661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0493dbd6e43d4f4592b4004e7823225d, user_id=a4f040bc4ea74fcfa2605b91d7dc94ff, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:37.198500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:37.215112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1117/2216] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:37 2022] PUT /identity/v3/projects/0493dbd6e43d4f4592b4004e7823225d/users/a4f040bc4ea74fcfa2605b91d7dc94ff/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:37.226368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.226645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.227188 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.261836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] MFA Rules not processed for user `a4f040bc4ea74fcfa2605b91d7dc94ff`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:37.263176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:37.375778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1100/2217] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:37.389107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:37.391470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:37.524912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29d7f26-bcec-4eef-a604-ce24847209a2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:37.542286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:37.542961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.543281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.543595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.556347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:37.557850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d749cd-14cf-4ad6-a048-a676c5639a55 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:37.585867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1118/2218] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:37.777310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:37.842461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:37.870746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f6d4b9-13c7-4dfc-ab13-02744157c025 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:37.879244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:37.879536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:37.879802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:37.880075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] PATH_INFO: `/v3/users/6e1e45ed5d854aa4bbf53e7d5370af8f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:37.881325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e1e45ed5d854aa4bbf53e7d5370af8f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:37.883454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:37.958186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e1e45ed5d854aa4bbf53e7d5370af8f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:37.958867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e1e45ed5d854aa4bbf53e7d5370af8f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:37.959699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e1e45ed5d854aa4bbf53e7d5370af8f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:37.976391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e1e45ed5d854aa4bbf53e7d5370af8f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:37.988273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e1e45ed5d854aa4bbf53e7d5370af8f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.010324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1101/2219] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:37 2022] DELETE /identity/v3/users/6e1e45ed5d854aa4bbf53e7d5370af8f => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:38.015134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:38.015559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:38.015985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:38.038974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:38.040536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:38.050526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:38.119950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1119/2220] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:38.134920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:38.136938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:38.223860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b88b53c-0a45-4636-9d52-fa0b282c821f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:38.227827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:38.228520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:38.229212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:38.229691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:38.242789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:38.255260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:38.270746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1102/2221] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:38.671924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:38.673487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:38.705918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064230cf-db81-4fca-8fa7-7c6e129f0610 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:38.722385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:38.723042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:38.723352 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:38.723623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] PATH_INFO: `/v3/projects/2675c89ae5f4473f859841d44473e0d0` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:38.731146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2675c89ae5f4473f859841d44473e0d0)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:38.733145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:38.864054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2675c89ae5f4473f859841d44473e0d0', 'request_id': 'req-6220838f-9f88-461a-bb83-d33e4e072fa4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.901079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2675c89ae5f4473f859841d44473e0d0', 'request_id': 'req-6220838f-9f88-461a-bb83-d33e4e072fa4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.919372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2675c89ae5f4473f859841d44473e0d0', 'request_id': 'req-6220838f-9f88-461a-bb83-d33e4e072fa4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.933811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] The token cache is being invalidate because project 2675c89ae5f4473f859841d44473e0d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:38.934175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.934848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:38.937964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1120/2222] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:38 2022] DELETE /identity/v3/projects/2675c89ae5f4473f859841d44473e0d0 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:38.941216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:38.955316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca304d1-e5e5-4a2d-8c06-61606f234210 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:39.106855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:39.107536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:39.107927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:39.108201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] PATH_INFO: `/v3/users/a4f040bc4ea74fcfa2605b91d7dc94ff` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:39.110653 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f040bc4ea74fcfa2605b91d7dc94ff)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:39.122070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:39.142158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:39.257133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f040bc4ea74fcfa2605b91d7dc94ff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:39.258175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f040bc4ea74fcfa2605b91d7dc94ff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:39.259403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f040bc4ea74fcfa2605b91d7dc94ff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:39.276793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f040bc4ea74fcfa2605b91d7dc94ff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:39.288230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f53e5c97-8b5d-46da-96b1-a18bd8b6a7ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f040bc4ea74fcfa2605b91d7dc94ff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:39.306265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1103/2223] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:38 2022] DELETE /identity/v3/users/a4f040bc4ea74fcfa2605b91d7dc94ff => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:39.872498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:39.874032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:39.889963 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6220838f-9f88-461a-bb83-d33e4e072fa4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:39.953739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:39.954494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:39.954775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:39.955278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] PATH_INFO: `/v3/projects/0493dbd6e43d4f4592b4004e7823225d` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:39.956997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=0493dbd6e43d4f4592b4004e7823225d)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:39.958994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.016581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:40.025438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0493dbd6e43d4f4592b4004e7823225d', 'request_id': 'req-d7a6cbcd-82d2-473e-88af-4271241b23ce'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:40.033196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0493dbd6e43d4f4592b4004e7823225d', 'request_id': 'req-d7a6cbcd-82d2-473e-88af-4271241b23ce'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:40.040741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0493dbd6e43d4f4592b4004e7823225d', 'request_id': 'req-d7a6cbcd-82d2-473e-88af-4271241b23ce'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:40.051426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] The token cache is being invalidate because project 0493dbd6e43d4f4592b4004e7823225d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:40.051714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:40.052437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d7a6cbcd-82d2-473e-88af-4271241b23ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:40.053930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1121/2224] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:39 2022] DELETE /identity/v3/projects/0493dbd6e43d4f4592b4004e7823225d => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:40.058824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.059232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.059382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.078742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:40.079985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:40.139935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1104/2225] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:40.148102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.148489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.148660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.168477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:40.170023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:40.178999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1122/2226] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:40.183934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.194223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c620d9-ccc9-4ac6-b28d-a2803567f22b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.198646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.199220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.199493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.199787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.200424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:40.200719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.202315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.214238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1105/2227] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:40.218469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.228251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75271bb-383e-4dfc-8c6f-d3f2359c52db None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.232859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.233448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.233744 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.234012 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.234634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.236594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.267275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1123/2228] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:40.269218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.279349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e09e289-7b7b-4419-9834-37a829f7e0a4 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.337977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.338720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.339029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.339300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.340023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.342479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.359603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:40.367918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1106/2229] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:53:40.370670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.383188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f71dcf67-ae52-40d6-892c-1965e159f81c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.388846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.390017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.390406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.390774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.391569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.394035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.409725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1124/2230] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:40.410995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.422205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d742b9b-302e-4814-9f05-d7904cfdf6c9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.439185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.440183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.441168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.441744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.442580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.448468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e18313c-cb6d-46c2-967d-ec0e602f984b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.464268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1107/2231] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:40.468488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.478786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2297e25-5a8d-422b-89c5-8c33370cb612 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.484145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.484802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.485079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.485355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] PATH_INFO: `/v3/projects/a217d01d83a14d0bb66309f10e2d502e/users/028a72d761604d4ab3939f8cce82a42c/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.500556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a217d01d83a14d0bb66309f10e2d502e, user_id=028a72d761604d4ab3939f8cce82a42c, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.503794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.519508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1125/2232] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:40 2022] PUT /identity/v3/projects/a217d01d83a14d0bb66309f10e2d502e/users/028a72d761604d4ab3939f8cce82a42c/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:40.529820 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.530100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.530372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.560620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] MFA Rules not processed for user `028a72d761604d4ab3939f8cce82a42c`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:40.561848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:40.625699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1108/2233] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:40.630634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.692325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ff49706-de0f-484a-996d-1a5f8dc69952 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.697014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.697548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.697829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.698102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.698728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.700671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.726601 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1126/2234] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/projects => generated 387 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:40.730706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.741778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2987d8d-bad3-44ea-a5bf-2d5dde7fbdf0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.796723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.797326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.797600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.797869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.798526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.800940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.823420 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1109/2235] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:40 2022] POST /identity/v3/users => generated 300 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:40.827286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.838063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb2f3ac-6466-471c-8f7a-b2a71fd9d6a5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.842872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.843530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.843840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.844115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.844756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.846363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.857046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1127/2236] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:40.861134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.871792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406ac9b7-c2a6-4339-a05e-91c8627e58da admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.876584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.877236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.877514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.877851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] PATH_INFO: `/v3/projects/402111b37ad6432aa61c158855f0affe/users/ac129f2dd1804589a1750e00556be4d4/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.895483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402111b37ad6432aa61c158855f0affe, user_id=ac129f2dd1804589a1750e00556be4d4, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.899049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:40.912219 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1110/2237] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:40 2022] PUT /identity/v3/projects/402111b37ad6432aa61c158855f0affe/users/ac129f2dd1804589a1750e00556be4d4/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:40.916263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:40.926967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e4319-f384-4a43-a5fe-c679e7a91378 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:40.966610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:40.990603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:40.991200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:40.991474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:40.991757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:40.992398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:40.993992 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bd66fb-bbc0-4ff0-b9eb-b6ba4eef451b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:41.003948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1128/2238] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:40 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:53:41.008161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:41.018685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec705011-4db5-4b6b-bcf2-c8697b0f4fc9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:41.023256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:41.024268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:41.024640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:41.025206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] PATH_INFO: `/v3/projects/402111b37ad6432aa61c158855f0affe/users/ac129f2dd1804589a1750e00556be4d4/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:41.026943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] RBAC: Authorizing `identity:create_grant(project_id=402111b37ad6432aa61c158855f0affe, user_id=ac129f2dd1804589a1750e00556be4d4, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:41.029470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:41.040921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1111/2239] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:41 2022] PUT /identity/v3/projects/402111b37ad6432aa61c158855f0affe/users/ac129f2dd1804589a1750e00556be4d4/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:41.052291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:41.052579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:41.052849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:41.080076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] MFA Rules not processed for user `ac129f2dd1804589a1750e00556be4d4`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:41.081376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:41.152397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1129/2240] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:41.163676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:41.165515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:41.196918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:41.222713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b147cc-a21e-4c80-a8e4-b4d0dee3b319 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:41.226605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:41.227204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:41.227478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:41.227767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:41.236610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:41.238607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca50bdf4-60ca-4cbb-b665-46a3704d07b8 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:41.248094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1112/2241] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:41 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:41.798533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:41.861250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c39a22-2e12-474d-9ce3-6d1c398835ba None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:41.866399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:41.867020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:41.867293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:41.867560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] PATH_INFO: `/v3/users/028a72d761604d4ab3939f8cce82a42c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:41.868689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=028a72d761604d4ab3939f8cce82a42c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:41.870600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:41.914495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '028a72d761604d4ab3939f8cce82a42c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:41.915132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '028a72d761604d4ab3939f8cce82a42c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:41.915722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '028a72d761604d4ab3939f8cce82a42c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:41.922454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '028a72d761604d4ab3939f8cce82a42c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:41.928443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:41.937468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '028a72d761604d4ab3939f8cce82a42c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:41.949865 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1130/2242] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:41 2022] DELETE /identity/v3/users/028a72d761604d4ab3939f8cce82a42c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:41.954419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:41.954704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:41.954976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:41.973886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:41.975080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:42.038383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1113/2243] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:42.048392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:42.050410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:42.114060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa3f12c-619d-4b9c-b0d5-9ddb655649b8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:42.118438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:42.119059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:42.119335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:42.119927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:42.131656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:42.133114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:42.144803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1131/2244] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:42.429825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:42.432459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:42.443870 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5163de40-1f77-4af8-b99b-cad974cba892 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:42.459295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:42.460317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:42.460547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:42.460826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] PATH_INFO: `/v3/projects/a217d01d83a14d0bb66309f10e2d502e` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:42.461976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a217d01d83a14d0bb66309f10e2d502e)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:42.464117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:42.527832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a217d01d83a14d0bb66309f10e2d502e', 'request_id': 'req-652fb030-6ee2-4559-820f-9eb34d20dce6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.533861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a217d01d83a14d0bb66309f10e2d502e', 'request_id': 'req-652fb030-6ee2-4559-820f-9eb34d20dce6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.539985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a217d01d83a14d0bb66309f10e2d502e', 'request_id': 'req-652fb030-6ee2-4559-820f-9eb34d20dce6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.554167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] The token cache is being invalidate because project a217d01d83a14d0bb66309f10e2d502e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:42.554453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.555075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.556624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1114/2245] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:42 2022] DELETE /identity/v3/projects/a217d01d83a14d0bb66309f10e2d502e => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:42.560634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:42.571492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c59019-ab8c-41c8-bce8-23e9499fb974 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:42.646487 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:42.647209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:42.647496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:42.647932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] PATH_INFO: `/v3/users/ac129f2dd1804589a1750e00556be4d4` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:42.649259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac129f2dd1804589a1750e00556be4d4)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:42.651207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:42.715591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac129f2dd1804589a1750e00556be4d4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.716414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac129f2dd1804589a1750e00556be4d4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.718723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac129f2dd1804589a1750e00556be4d4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.729330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac129f2dd1804589a1750e00556be4d4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.745446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-25eec123-e2d3-48e5-a5e2-d8b2e4337b4e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac129f2dd1804589a1750e00556be4d4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:42.762634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:42.784240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1132/2246] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:42 2022] DELETE /identity/v3/users/ac129f2dd1804589a1750e00556be4d4 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:43.127225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.130340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:43.191961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652fb030-6ee2-4559-820f-9eb34d20dce6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.287161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:43.301396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.302802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.303352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.303797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] PATH_INFO: `/v3/projects/402111b37ad6432aa61c158855f0affe` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.305316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] RBAC: Authorizing `identity:delete_project(project_id=402111b37ad6432aa61c158855f0affe)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.307808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.380321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '402111b37ad6432aa61c158855f0affe', 'request_id': 'req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:43.387679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '402111b37ad6432aa61c158855f0affe', 'request_id': 'req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:43.396853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '402111b37ad6432aa61c158855f0affe', 'request_id': 'req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:43.420320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] The token cache is being invalidate because project 402111b37ad6432aa61c158855f0affe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:43.420698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:43.421330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-bc65641f-6ad4-4b65-97d6-95f7e6c2955d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:43.423474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1115/2247] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:43 2022] DELETE /identity/v3/projects/402111b37ad6432aa61c158855f0affe => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:43.428958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.429438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.429519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.450210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:43.451492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:43.512688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1133/2248] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:43.521084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.521576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.521777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.542397 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:43.543534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:43.552060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1116/2249] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:43.556486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.566170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf825bc-0f73-491b-82cd-e7a1fb57c9f2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.571948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.572561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.575849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.575849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.575849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:53:43.575849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.576213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.589047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1134/2250] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:53:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:53:43.593314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.603360 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e6151-2aa3-4acb-b41c-7ec3e599b3aa None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.608284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.608876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.609150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.609416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.610125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.612666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.639032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1117/2251] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:53:43 2022] POST /identity/v3/projects => generated 377 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:43.643434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.653516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc678c6d-df4e-4fe5-ab1f-21c8e8d49f52 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.710361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.710980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.711250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.711524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.712200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.714121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.735642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1135/2252] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:53:43 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:53:43.739769 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.750867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cec30165-9196-420a-895f-aeb169c0fe0f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.755437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.756056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.756337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.756608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.757243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.758826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.769234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1118/2253] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:43.773488 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.783330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83470a1-36cf-40c6-8059-364267afd759 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.789575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.790182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.790463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.790737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.791380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.793574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a30ac6-a20e-4130-99a3-68c84cf9bf69 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.808941 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1136/2254] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:53:43 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:53:43.813280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.823286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f07e0-7947-4133-95e6-f1726fb826a7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:43.827935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:43.828571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.828846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.829118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] PATH_INFO: `/v3/projects/13bd17e1928b40099f2a79f174599a18/users/207fcc2568f1494fa02ebbbcd00122a0/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.843999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] RBAC: Authorizing `identity:create_grant(project_id=13bd17e1928b40099f2a79f174599a18, user_id=207fcc2568f1494fa02ebbbcd00122a0, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:43.847282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:43.859929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1119/2255] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:53:43 2022] PUT /identity/v3/projects/13bd17e1928b40099f2a79f174599a18/users/207fcc2568f1494fa02ebbbcd00122a0/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:43.872795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:43.873252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:43.873620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:43.901858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] MFA Rules not processed for user `207fcc2568f1494fa02ebbbcd00122a0`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:43.903073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:43.958380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:43.968285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1137/2256] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:43 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:53:43.979890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:43.981633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:44.060299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d8d7b-72a2-4465-bd47-b2156871fc0d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:44.064099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:44.064699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:44.064970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:44.065755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:44.074664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:44.076132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31c3fee6-baf6-4f8e-9a7d-e0c450973770 service glance] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:44.086341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1120/2257] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:43 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:48.108769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:48.110240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:48.188086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0d67fa-55cf-4147-82ad-9564875bcfd5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:48.193342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:48.193988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:48.194236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:48.194510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] PATH_INFO: `/v3/users/37091762784749e487668352331e8c5f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:48.195644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=37091762784749e487668352331e8c5f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:48.197704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:48.255906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37091762784749e487668352331e8c5f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.256617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37091762784749e487668352331e8c5f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.257244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37091762784749e487668352331e8c5f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.264923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37091762784749e487668352331e8c5f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.277226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37091762784749e487668352331e8c5f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.291355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1138/2258] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:53:48 2022] DELETE /identity/v3/users/37091762784749e487668352331e8c5f => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:53:48.295610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:48.296176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:48.296910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:48.305603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:48.318774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:48.320112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:48.394480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1121/2259] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:53:48.404017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:48.405428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:48.478376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd789d59-2b10-4709-84c9-498428849f3f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:48.482490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:48.483101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:48.483375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:48.483649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:48.493935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:48.495582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a49fe78-cc39-4327-a7cb-f452240a71b6 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:48.509407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1139/2260] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:53:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:53:48.820672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:53:48.822167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:48.835227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d742f31-ccaf-452b-9723-44d39f71ad7b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:53:48.847654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:53:48.848936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:48.849216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:48.849489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] PATH_INFO: `/v3/projects/c8b44fb6662045138e0e077c5f7704f8` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:48.850845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8b44fb6662045138e0e077c5f7704f8)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:53:48.852835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:53:48.903664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8b44fb6662045138e0e077c5f7704f8', 'request_id': 'req-0988aeb3-9741-4f09-bffd-d70870355e1a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.910369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8b44fb6662045138e0e077c5f7704f8', 'request_id': 'req-0988aeb3-9741-4f09-bffd-d70870355e1a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.916746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8b44fb6662045138e0e077c5f7704f8', 'request_id': 'req-0988aeb3-9741-4f09-bffd-d70870355e1a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.929807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] The token cache is being invalidate because project c8b44fb6662045138e0e077c5f7704f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:53:48.930103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.930971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:53:48.932527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1122/2261] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:53:48 2022] DELETE /identity/v3/projects/c8b44fb6662045138e0e077c5f7704f8 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:53:58.504354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=81,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:58.926116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=52,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:53:59.751181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03406-7d2c-4f3a-904e-6af9e4950df1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:53:59.751710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03406-7d2c-4f3a-904e-6af9e4950df1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:53:59.751710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b03406-7d2c-4f3a-904e-6af9e4950df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:53:59.771087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f0b03406-7d2c-4f3a-904e-6af9e4950df1 None None] MFA Rules not processed for user `c06f8365a64b4a0cbd22bc9c4b3da595`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:53:59.772303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f0b03406-7d2c-4f3a-904e-6af9e4950df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:53:59.832295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1140/2262] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:53:59 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:09.825139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=25 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:15.911263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:15.912725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:15.974955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0988aeb3-9741-4f09-bffd-d70870355e1a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:15.980039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:15.980661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:15.980935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:15.981203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] PATH_INFO: `/v3/users/207fcc2568f1494fa02ebbbcd00122a0` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:15.982300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=207fcc2568f1494fa02ebbbcd00122a0)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:15.984225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:16.030292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '207fcc2568f1494fa02ebbbcd00122a0'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.030934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '207fcc2568f1494fa02ebbbcd00122a0'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.031540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '207fcc2568f1494fa02ebbbcd00122a0'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.043958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '207fcc2568f1494fa02ebbbcd00122a0'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.050625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '207fcc2568f1494fa02ebbbcd00122a0'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.062948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1123/2263] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:54:15 2022] DELETE /identity/v3/users/207fcc2568f1494fa02ebbbcd00122a0 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:54:16.067386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.067887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.067994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.086830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:16.088050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:16.152878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1141/2264] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:16.162401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:16.163853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:16.225539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1937c7-f5a1-4601-ab91-91a09d8925fb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:16.229656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:16.230247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.230520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.230789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.239490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:16.240938 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8db72b38-aa9d-44ab-b024-b0cfe970f382 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:16.250789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1124/2265] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:16.616800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:16.618738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:16.630437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef5817d-d79f-473d-87d3-e2d3eee2c0cf None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:16.635657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:16.636304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.636583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.636855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] PATH_INFO: `/v3/projects/13bd17e1928b40099f2a79f174599a18` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.637968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13bd17e1928b40099f2a79f174599a18)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:16.640161 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:16.688341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13bd17e1928b40099f2a79f174599a18', 'request_id': 'req-fa548697-e369-4a4b-acab-b75be2901924'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.699111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13bd17e1928b40099f2a79f174599a18', 'request_id': 'req-fa548697-e369-4a4b-acab-b75be2901924'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.707367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13bd17e1928b40099f2a79f174599a18', 'request_id': 'req-fa548697-e369-4a4b-acab-b75be2901924'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.720267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] The token cache is being invalidate because project 13bd17e1928b40099f2a79f174599a18 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:54:16.720586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.721245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fa548697-e369-4a4b-acab-b75be2901924 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:16.722818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1142/2266] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:54:16 2022] DELETE /identity/v3/projects/13bd17e1928b40099f2a79f174599a18 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:54:16.727681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.728003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.728300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.749424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:16.750696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:16.768705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:16.816947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1125/2267] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:54:16.826249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.826593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.826934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.847048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:16.848277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:16.856990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1143/2268] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:54:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:16.861237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:16.871315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed14178-b34c-4911-84ab-2595f86a8586 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:16.875871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:16.876472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.876746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.877013 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.877649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:54:16.877945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:16.879564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:16.891331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1126/2269] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:54:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:54:16.895659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:16.905475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e017f0e2-da80-4642-be5c-1bfb187bab52 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:16.910104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:16.910694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:16.910970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:16.911240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:16.911921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:16.913889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:16.945298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1144/2270] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:54:16 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:54:16.946684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:16.956655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e385fe6-1440-4fac-962e-9901452d5ce6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:17.014792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:17.015398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.015673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.016079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.016717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:17.018616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:17.041279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1127/2271] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:54:16 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:54:17.045055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:17.055532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d07569-1e72-40ce-97ff-f82e1f685001 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:17.060255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:17.060857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.061150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.061423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.062058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:17.063657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:17.074581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1145/2272] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:54:17.078467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:17.088952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e1d4c8-d21f-45dc-93e8-f6fab074aa16 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:17.093662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:17.094256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.094532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.094801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.095439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:17.097089 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19c510-86c0-4be3-857b-c41e2320a641 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:17.108100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1128/2273] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:54:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:54:17.112216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:17.123660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a77c28-2d08-4c94-8d7d-94cfe78bd8a3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:17.129219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:17.130088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.130584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.131086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] PATH_INFO: `/v3/projects/d2c1773b018947fe903103d65b48304f/users/0ca61eaeb6f54056817c2611ec7e16c4/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.147938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2c1773b018947fe903103d65b48304f, user_id=0ca61eaeb6f54056817c2611ec7e16c4, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:17.153135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:17.168563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1146/2274] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:54:17 2022] PUT /identity/v3/projects/d2c1773b018947fe903103d65b48304f/users/0ca61eaeb6f54056817c2611ec7e16c4/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:54:17.180173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6b9e-e58f-434a-8257-66986968c497 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.180451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6b9e-e58f-434a-8257-66986968c497 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.180910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45c6b9e-e58f-434a-8257-66986968c497 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.209260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f45c6b9e-e58f-434a-8257-66986968c497 None None] MFA Rules not processed for user `0ca61eaeb6f54056817c2611ec7e16c4`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:17.210413 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f45c6b9e-e58f-434a-8257-66986968c497 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:17.275437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1129/2275] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:54:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:17.287423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:17.289811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:17.313801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:17.352995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a0793c-f22d-482e-8e5f-2b4d63e2a21d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:17.356689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:17.357306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:17.357583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:17.357855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:17.367561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:17.369062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:17.378783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1147/2276] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:24.986886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f437b-fc72-426a-a01d-a04778f8ab22 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:24.987437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f437b-fc72-426a-a01d-a04778f8ab22 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:24.987437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f437b-fc72-426a-a01d-a04778f8ab22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:25.007530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-1c2f437b-fc72-426a-a01d-a04778f8ab22 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:25.008784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1c2f437b-fc72-426a-a01d-a04778f8ab22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:25.022015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:25.072143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1130/2277] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:25.113950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:25.115372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:25.190861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649d88-ea00-4746-8401-69482b60e6d7 service glance] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:25.196411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:25.197049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:25.197327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:25.197596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:25.206777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:25.208491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:25.218736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1148/2278] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:30.080117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4066-041b-4377-ba8d-649664eb8ab9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:30.080644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4066-041b-4377-ba8d-649664eb8ab9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:30.080644 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ee4066-041b-4377-ba8d-649664eb8ab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:30.102914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-09ee4066-041b-4377-ba8d-649664eb8ab9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:30.104187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-09ee4066-041b-4377-ba8d-649664eb8ab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:30.118189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1131/2279] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:30.165299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:30.166782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:30.183081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e688124-2a68-4d6b-8012-a2e72df96fca service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:30.188637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:30.189233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:30.189519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:30.189793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:30.197932 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:30.199608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:30.209517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1149/2280] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:34.482327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187f223-381d-4b68-8773-46f67aeb7156 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:34.482789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187f223-381d-4b68-8773-46f67aeb7156 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:34.482904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7187f223-381d-4b68-8773-46f67aeb7156 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:34.502542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7187f223-381d-4b68-8773-46f67aeb7156 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:34.503869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7187f223-381d-4b68-8773-46f67aeb7156 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:34.511638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1132/2281] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:34.534056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:34.545815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e06c3b-a7cc-44ed-b4c3-ab45766e66ec service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:34.551676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:34.552316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:34.552595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:34.552869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:34.561019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:34.562875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:34.572262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1150/2282] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:38.450382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8332-9358-4806-9acd-7dcf2cbc7574 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:38.450862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8332-9358-4806-9acd-7dcf2cbc7574 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:38.450957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18d8332-9358-4806-9acd-7dcf2cbc7574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:38.471195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e18d8332-9358-4806-9acd-7dcf2cbc7574 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:38.472435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e18d8332-9358-4806-9acd-7dcf2cbc7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:38.480250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1133/2283] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:38.502434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:38.514462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19ee7ac-ddc4-4b8c-9cce-466aa46ae192 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:38.520003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:38.520597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:38.520876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:38.521146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:38.529271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:38.530844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:38.540179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1151/2284] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:43.658801 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec7e5-59b0-49ea-97b7-001adb2cd213 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:43.659314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec7e5-59b0-49ea-97b7-001adb2cd213 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:43.659547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188ec7e5-59b0-49ea-97b7-001adb2cd213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:43.684941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-188ec7e5-59b0-49ea-97b7-001adb2cd213 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:43.686183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-188ec7e5-59b0-49ea-97b7-001adb2cd213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:43.695019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1134/2285] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:43.724947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:43.735841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1dc641-a840-4397-91a0-e7ca8a079157 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:43.741422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:43.742014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:43.742296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:43.742569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:43.751344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:43.752949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:43.762771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1152/2286] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:47.845834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:47.846338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:47.846446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:47.866866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:47.868094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:47.876818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1135/2287] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:54:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:47.902962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:47.908871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=76 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:47.914954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac222d5a-26d1-4725-b313-5781fda3ca15 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:47.920924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:47.921510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:47.921787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:47.922059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:47.930067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:47.931633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae875421-d54a-41b4-afee-9e37cde2b5f9 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:47.941686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1153/2288] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:51.617728 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:51.628083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-145741bb-e88d-4c0a-badf-084ba9d9343f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:51.632517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:51.633128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:51.633404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:51.633673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] PATH_INFO: `/v3/users/0ca61eaeb6f54056817c2611ec7e16c4` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:51.634786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=0ca61eaeb6f54056817c2611ec7e16c4)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:51.636800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:51.682379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0ca61eaeb6f54056817c2611ec7e16c4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:51.683662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0ca61eaeb6f54056817c2611ec7e16c4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:51.684277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0ca61eaeb6f54056817c2611ec7e16c4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:51.695828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0ca61eaeb6f54056817c2611ec7e16c4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:51.702590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0ca61eaeb6f54056817c2611ec7e16c4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:51.715221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1136/2289] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:54:51 2022] DELETE /identity/v3/users/0ca61eaeb6f54056817c2611ec7e16c4 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:54:51.719850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:51.720331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:51.720434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:51.740863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:54:51.742055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:51.799552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1154/2290] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:54:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:54:51.809290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:51.810740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:51.867212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b40867a-3b15-4f30-898b-82a2f230e4ae admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:51.870758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:51.871363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:51.871640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:51.871951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:51.880813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:51.882224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f72ed9-6f99-4b92-a03f-2437ed40c981 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:51.887084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:54:51.892084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1137/2291] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:54:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:54:52.169675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:54:52.171449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:54:52.187500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18eccd5e-371c-47c5-9bd3-6bce6e6fd3f9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:54:52.192522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:54:52.193243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:54:52.193454 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:54:52.193746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] PATH_INFO: `/v3/projects/d2c1773b018947fe903103d65b48304f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:54:52.194879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2c1773b018947fe903103d65b48304f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:54:52.196906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:54:52.270899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2c1773b018947fe903103d65b48304f', 'request_id': 'req-933e492a-ad31-4b6a-8572-217f4a2e28ba'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:52.270899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2c1773b018947fe903103d65b48304f', 'request_id': 'req-933e492a-ad31-4b6a-8572-217f4a2e28ba'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:52.270899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2c1773b018947fe903103d65b48304f', 'request_id': 'req-933e492a-ad31-4b6a-8572-217f4a2e28ba'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:52.281940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] The token cache is being invalidate because project d2c1773b018947fe903103d65b48304f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:54:52.282234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:52.283035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-933e492a-ad31-4b6a-8572-217f4a2e28ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:54:52.284571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1155/2292] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:54:52 2022] DELETE /identity/v3/projects/d2c1773b018947fe903103d65b48304f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:55:02.278537 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=59,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:04.432600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:04.433141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:04.433141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:04.452320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] MFA Rules not processed for user `b639c5b532cc4267b39b643ead162c14`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:04.453515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:04.506070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1138/2293] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:55:04 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:14.499662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=25 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:20.785995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d590-e3ea-4911-8cab-ec0c9870a03e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:20.786598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d590-e3ea-4911-8cab-ec0c9870a03e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:20.786703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b3d590-e3ea-4911-8cab-ec0c9870a03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:20.806829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-27b3d590-e3ea-4911-8cab-ec0c9870a03e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:20.808064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-27b3d590-e3ea-4911-8cab-ec0c9870a03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:20.864667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1156/2294] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:55:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:20.886079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:20.887551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:20.963230 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0fc23-3015-4686-ab22-58163e5da4f7 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:20.969389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:20.970139 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:20.970416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:20.970687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:20.978756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:20.980357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:20.990442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1139/2295] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:25.187049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ec3a-3b54-4821-85a1-a59f194bcd72 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:25.187610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ec3a-3b54-4821-85a1-a59f194bcd72 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:25.187610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c4ec3a-3b54-4821-85a1-a59f194bcd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:25.207370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-03c4ec3a-3b54-4821-85a1-a59f194bcd72 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:25.208664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-03c4ec3a-3b54-4821-85a1-a59f194bcd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:25.216561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1157/2296] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:55:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:25.240614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:25.241966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:25.257347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07deec5a-bc4a-45b1-af25-89808c48e91a service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:25.263914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:25.264830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:25.265112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:25.265385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:25.274272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:25.275921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:25.286020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1140/2297] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:30.383018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509dac-962f-4f61-ae40-19d881165a79 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:30.383534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509dac-962f-4f61-ae40-19d881165a79 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:30.383636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a509dac-962f-4f61-ae40-19d881165a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:30.403591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0a509dac-962f-4f61-ae40-19d881165a79 None None] MFA Rules not processed for user `c32d9ea3c6a44d15b2b050e99524b56e`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:30.404809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0a509dac-962f-4f61-ae40-19d881165a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:30.459673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1158/2298] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:55:30 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:31.868505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:31.869994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:31.944105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e638a81a-fb7f-4b69-b198-6206f81386f7 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:31.949419 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:31.950187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:31.950475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:31.950751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:31.952535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:31.969456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:31.971058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:31.981907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1141/2299] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:32.312050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe48a-b923-4d86-95dd-a836baba4c87 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:32.312590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe48a-b923-4d86-95dd-a836baba4c87 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:32.312590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7cbe48a-b923-4d86-95dd-a836baba4c87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:32.331406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e7cbe48a-b923-4d86-95dd-a836baba4c87 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:32.332893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e7cbe48a-b923-4d86-95dd-a836baba4c87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:32.341218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1159/2300] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:55:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:32.362869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:32.375404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e34a59-d369-48ac-8b3d-b89fac05d12d service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:32.380913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:32.381489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:32.381767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:32.382039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:32.390496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:32.392075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:32.402043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1142/2301] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:35.130519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038163-6ae6-4a6e-bee8-7151e2d48ae7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:35.131026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038163-6ae6-4a6e-bee8-7151e2d48ae7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:35.131125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa038163-6ae6-4a6e-bee8-7151e2d48ae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:35.150664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fa038163-6ae6-4a6e-bee8-7151e2d48ae7 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:35.151895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fa038163-6ae6-4a6e-bee8-7151e2d48ae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:35.207422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1160/2302] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:55:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:35.254825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:35.256275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:35.305463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:35.328283 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b20648-db8f-47ee-ac8a-9162a3a05cdc service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:35.333320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:35.333926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:35.334203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:35.334470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:35.342465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:35.344101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:35.352063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1143/2303] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 04:55:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 04:55:37.710137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcf09-1b7e-4df6-a482-da1a9db65f0b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:37.710731 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcf09-1b7e-4df6-a482-da1a9db65f0b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:37.711660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dcf09-1b7e-4df6-a482-da1a9db65f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:37.742321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5e9dcf09-1b7e-4df6-a482-da1a9db65f0b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:37.744578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5e9dcf09-1b7e-4df6-a482-da1a9db65f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:37.756706 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1161/2304] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:55:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 04:55:37.778775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:37.792145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e44ae30-071f-45f0-894c-d29576b6531b service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:37.800502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:37.801430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:37.801945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:37.802449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:37.812170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:37.814101 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:37.826565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1144/2305] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:46.062110 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2e08-c92c-4832-8e55-de1cb3481078 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:46.063058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2e08-c92c-4832-8e55-de1cb3481078 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:46.063334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eeb2e08-c92c-4832-8e55-de1cb3481078 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:46.071206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:55:46.086395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5eeb2e08-c92c-4832-8e55-de1cb3481078 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:46.087902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5eeb2e08-c92c-4832-8e55-de1cb3481078 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:46.097062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1162/2306] 10.222.0.26 () {58 vars in 1016 bytes} [Tue Sep 20 04:55:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:46.128241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:46.142399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d1857d-409e-4557-bfee-c5bc4fb67852 service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:46.148557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:46.149522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:46.149955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:46.150391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:46.160124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:46.161817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1389dc70-0966-4aa2-b218-b3fd3106231a service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:46.172507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1145/2307] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:55.541610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.542197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.542301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.544441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1163/2308] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:55:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:55:55.551048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d855-83b2-4f25-811e-486e2a3748d5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.551518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d855-83b2-4f25-811e-486e2a3748d5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.551640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d68d855-83b2-4f25-811e-486e2a3748d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.571256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6d68d855-83b2-4f25-811e-486e2a3748d5 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:55.572501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6d68d855-83b2-4f25-811e-486e2a3748d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:55.581877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1146/2309] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:55:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:55.593603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:55.595400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:55.654040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6a182d-f15c-488c-ae76-81cf4356e5f4 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:55.657648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:55.658252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.658527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.658797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.669064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:55.670478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59e1f50-15a6-4061-ab94-b520144748ab service glance] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:55.681121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1164/2310] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:55.750017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.750240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.750487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.751846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1147/2311] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:55:55.756458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ecef-8a72-483c-8555-654f9d3f3b92 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.756737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ecef-8a72-483c-8555-654f9d3f3b92 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.757005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14ecef-8a72-483c-8555-654f9d3f3b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.776864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ea14ecef-8a72-483c-8555-654f9d3f3b92 None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:55.778099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ea14ecef-8a72-483c-8555-654f9d3f3b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:55.827856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1165/2312] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:55:55 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:55.839453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:55.841168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:55.854129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7623a45-ac4c-4f6a-ab10-20d4834721a4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:55.858126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:55.858708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.858980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.859250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.866071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:55.867449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3866d6-4d78-4a09-8a67-b7506e76dd3d service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:55.875846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1148/2313] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:55 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:55:55.958123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.958414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.958691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.960089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1166/2314] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 04:55:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 04:55:55.965490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3beb6-44c6-4b03-b313-12f3dd66e546 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:55.966379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3beb6-44c6-4b03-b313-12f3dd66e546 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:55.966682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c3beb6-44c6-4b03-b313-12f3dd66e546 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:55.988236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b8c3beb6-44c6-4b03-b313-12f3dd66e546 None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:55:55.989483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b8c3beb6-44c6-4b03-b313-12f3dd66e546 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:55.999460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1149/2315] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 04:55:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:55:56.010637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:55:56.013531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:55:56.030775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ea9e7f-fb0f-43f5-a475-ade958352daa None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:55:56.034376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:55:56.034978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:55:56.035263 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:55:56.035523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:55:56.046592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:55:56.048043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:55:56.058886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1167/2316] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:55:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:56:02.072031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:02.072502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:02.072607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:02.093484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:56:02.094709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:56:02.102328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1150/2317] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 04:56:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:56:02.120274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:56:02.132841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c049102-67c1-4731-8935-e57bc1eff1f2 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:56:02.138309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:56:02.138993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:02.139267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:02.139533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:02.149639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:56:02.151203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:56:02.159639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1168/2318] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 04:56:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 04:56:12.087001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=37 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:12.156496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=63 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:22.766828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:56:22.768598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:56:22.786046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cac1ded-b887-4e0d-b432-31416a88f8ce None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:56:22.790970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:56:22.791850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:22.792160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:22.792459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] PATH_INFO: `/v3/users/b639c5b532cc4267b39b643ead162c14` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:22.793692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b639c5b532cc4267b39b643ead162c14)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:56:22.795592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:56:22.841869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b639c5b532cc4267b39b643ead162c14'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:22.842509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b639c5b532cc4267b39b643ead162c14'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:22.843100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b639c5b532cc4267b39b643ead162c14'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:22.855157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b639c5b532cc4267b39b643ead162c14'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:22.861894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-9f754d2e-e739-422d-8a50-4e6522c06f19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b639c5b532cc4267b39b643ead162c14'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:22.875154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1151/2319] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:56:22 2022] DELETE /identity/v3/users/b639c5b532cc4267b39b643ead162c14 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:56:23.041433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:56:23.054154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa18e9a9-c67f-41be-a2e4-fa2d928ba4a5 service swift] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:56:23.111201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:56:23.111876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:23.112143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:23.112411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] PATH_INFO: `/v3/projects/ecd17dd4fa104a0f9e276cd7820dd140` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:23.113520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ecd17dd4fa104a0f9e276cd7820dd140)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:56:23.115417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:56:23.160383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ecd17dd4fa104a0f9e276cd7820dd140', 'request_id': 'req-133d98eb-148f-4402-a829-406d4a1cf542'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:23.167167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ecd17dd4fa104a0f9e276cd7820dd140', 'request_id': 'req-133d98eb-148f-4402-a829-406d4a1cf542'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:23.173986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ecd17dd4fa104a0f9e276cd7820dd140', 'request_id': 'req-133d98eb-148f-4402-a829-406d4a1cf542'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:23.184407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] The token cache is being invalidate because project ecd17dd4fa104a0f9e276cd7820dd140 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:56:23.184717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:23.185278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:56:23.186750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1169/2320] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:56:23 2022] DELETE /identity/v3/projects/ecd17dd4fa104a0f9e276cd7820dd140 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:56:28.288060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70d97e-bd31-4f55-9e03-d53e444d1fe1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:28.288552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70d97e-bd31-4f55-9e03-d53e444d1fe1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:28.288738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f70d97e-bd31-4f55-9e03-d53e444d1fe1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:28.311554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8f70d97e-bd31-4f55-9e03-d53e444d1fe1 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:56:28.312996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8f70d97e-bd31-4f55-9e03-d53e444d1fe1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:56:28.369885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1152/2321] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 04:56:28 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:56:28.382524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:56:28.383959 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:56:28.454307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-133d98eb-148f-4402-a829-406d4a1cf542 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:56:28.459251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:56:28.459904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:28.460189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:28.460462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:28.468986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:56:28.470562 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:56:28.478482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1170/2322] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 04:56:28 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 04:56:38.363280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=54,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:38.475251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=83,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:56:48.070061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:56:48.070609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:56:48.070609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:56:48.089844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] MFA Rules not processed for user `c06f8365a64b4a0cbd22bc9c4b3da595`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:56:48.091645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:56:48.148258 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1153/2323] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:56:48 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:56:58.141489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=25 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:18.762674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:18.764226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:18.820245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b74ef00-5353-4aa0-97d9-3f3354fa4daa service swift] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:18.823850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:18.824444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:18.824724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:18.824993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:18.826661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:18.894710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:18.896169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:18.907002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1171/2324] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:20.310311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:20.311800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:20.366133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810cb582-f89f-49dd-baaf-2709a38c70b2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:20.369608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:20.370789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:20.371058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:20.371320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:20.372986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:20.385848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:20.387256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed08eea6-ac20-4eff-8b18-fa5d4ee0011c service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:20.398189 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1154/2325] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:27.471610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:27.481351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb51751-e913-4483-adf1-2530b79c6fb0 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:27.485146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:27.485746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:27.486025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:27.486293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:27.488089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:27.547399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:27.548853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:27.557906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1172/2326] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:30.393564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=26 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:31.840542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:31.841136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:31.841136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:31.860561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] MFA Rules not processed for user `c32d9ea3c6a44d15b2b050e99524b56e`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:57:31.861762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:31.868617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1155/2327] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:57:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:57:32.168236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:32.176720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca601c-d1d5-4e89-b3d5-30baaaf5a3f4 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:32.180306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:32.180899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:32.181178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:32.181451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:32.183134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:32.192867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:32.194298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:32.202734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1173/2328] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:32.514854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:32.516345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:32.587224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20c1ee9-c3f7-42ea-a10b-b6d54d656768 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:32.592639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:32.593242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:32.593518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:32.593787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:32.595481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:32.607124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:32.608827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:32.618494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1156/2329] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:35.734022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:35.742437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e579ac7a-439d-46e1-8889-692b177c3cf2 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:35.746043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:35.746631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:35.746909 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:35.747176 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:35.748915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:35.758127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:35.759538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:35.767584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1174/2330] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:42.614268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=35 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:45.764202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=94 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:57:45.821974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:45.823927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:45.839143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9d1887-d041-4f9c-b4bb-e79b566f68ff service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:45.844544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:45.845137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:45.845411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:45.845680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:45.847348 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:45.906276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:45.907901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12494d5c-6b07-4e14-80e3-811ff62967f8 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:45.916949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1157/2331] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:45 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:46.491790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:57:46.493199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:46.509050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d979c9-9d64-4512-8f6a-9026bd62b387 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:57:46.514714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:57:46.515306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:46.515598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:46.515878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:46.517618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:46.529779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:57:46.531407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:57:46.542648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1175/2332] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:57:46 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:57:54.083859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:57:54.084361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:57:54.084474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:57:54.103657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] MFA Rules not processed for user `65341da46cb04d5b898687920dcafc80`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:57:54.104896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:57:54.113697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1158/2333] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:57:54 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:57:56.537489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=6 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:00.634726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:00.636571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:00.647563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c297f7ad-836b-4945-96d7-c78f37b3edd3 service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:00.651240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:00.651874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:00.652154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:00.652423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:00.654094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:00.666574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:00.668043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:00.677324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1176/2334] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:00 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:04.022510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:04.035959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8d7d6-d108-4c62-b9c2-f4b2f488c7f6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:04.041305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:04.041918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:04.042191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:04.042464 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:04.044243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:04.057630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:04.058712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:04.070602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1159/2335] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:08.853765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:08.887307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e8c02d-ceac-4be2-878c-5421ccae8f28 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:08.894050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:08.896373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:08.896759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:08.897218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:08.905523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:08.926747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:08.928534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:08.944347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1177/2336] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:08 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:14.065645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=37 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:18.936481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=12 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:22.414691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:22.416143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:22.427296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f33577-242f-47ad-b81f-6ed7367987ac service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:22.430877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:22.431470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:22.431776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:22.432058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:22.433740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:22.495091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:22.496560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:22.506497 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1160/2337] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:26.131527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.134214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:26.157903 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0495dc4b-edb5-46d8-a5f4-ff843e5f21ca service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.162436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.163059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.163334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.163605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] PATH_INFO: `/v3/users/c06f8365a64b4a0cbd22bc9c4b3da595` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.165318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=c06f8365a64b4a0cbd22bc9c4b3da595)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.167221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.213450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c06f8365a64b4a0cbd22bc9c4b3da595'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.214108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c06f8365a64b4a0cbd22bc9c4b3da595'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.214718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c06f8365a64b4a0cbd22bc9c4b3da595'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.221650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c06f8365a64b4a0cbd22bc9c4b3da595'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.233930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-ffbe44fc-ba0d-45e0-b305-5ed6c91493bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c06f8365a64b4a0cbd22bc9c4b3da595'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.246717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1178/2338] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:26 2022] DELETE /identity/v3/users/c06f8365a64b4a0cbd22bc9c4b3da595 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:26.415697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.425838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3654e4-c7cf-4e62-9590-8dbb9d640f37 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.485904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.486527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.486804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.487074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] PATH_INFO: `/v3/projects/195dc1d92dbc435e935c954243cfae36` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.488196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] RBAC: Authorizing `identity:delete_project(project_id=195dc1d92dbc435e935c954243cfae36)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.490086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.535958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '195dc1d92dbc435e935c954243cfae36', 'request_id': 'req-66c2d268-7250-4ab7-949f-5deca760e30c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.542625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '195dc1d92dbc435e935c954243cfae36', 'request_id': 'req-66c2d268-7250-4ab7-949f-5deca760e30c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.548171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '195dc1d92dbc435e935c954243cfae36', 'request_id': 'req-66c2d268-7250-4ab7-949f-5deca760e30c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.559929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] The token cache is being invalidate because project 195dc1d92dbc435e935c954243cfae36 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:26.560214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.560831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66c2d268-7250-4ab7-949f-5deca760e30c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:26.562297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1161/2339] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:26 2022] DELETE /identity/v3/projects/195dc1d92dbc435e935c954243cfae36 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:26.567196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.567484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.567785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.587631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:26.588876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:26.647247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1179/2340] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:26.655511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.655831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.656109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.677078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:26.678286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:26.686223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1162/2341] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:26.690256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.699924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694bb9e6-ce1b-41da-80fa-4ea842b38b91 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.704485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.705075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.705355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.705625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.706264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:58:26.706564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.708194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.720111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1180/2342] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:58:26.724236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.733942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46741e3e-95f2-41b1-9f04-3f2dc5eb7146 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.738514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.739099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.739378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.739646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.740307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.742202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.756934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:26.772303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1163/2343] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:26 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:26.774698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.784559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38062146-1f06-48e6-8bd7-2e2f19053d29 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.841606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.842252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.842564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.842895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.844053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.846204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.855899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:26.870608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1181/2344] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:26 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:26.874789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.885596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924983e6-5f5c-47fe-be44-e36e6845fb08 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.890076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.890665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.890936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.891203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.891871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.893454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.904433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1164/2345] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:26.908408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.918121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49817db-cb49-4566-9a15-c096012cdf4f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.922888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.923480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.923789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.924113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.924748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.926390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b731a2-9e74-4b76-bf11-2005bca48505 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.936781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1182/2346] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:26 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:26.940636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:26.950941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0885b5-f6f2-47a4-8ef9-77e10b17fc7b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:26.955519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:26.956193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:26.956467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:26.956735 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] PATH_INFO: `/v3/projects/ce541813a9e34591ae74698fa94e757c/users/0c958036e9814f0f89d6bd34a68be5ea/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:26.975074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce541813a9e34591ae74698fa94e757c, user_id=0c958036e9814f0f89d6bd34a68be5ea, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:26.977746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:26.990738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1165/2347] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:26 2022] PUT /identity/v3/projects/ce541813a9e34591ae74698fa94e757c/users/0c958036e9814f0f89d6bd34a68be5ea/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:27.001054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:27.001339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:27.001631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:27.030142 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] MFA Rules not processed for user `0c958036e9814f0f89d6bd34a68be5ea`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:27.031362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:27.094515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1183/2348] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:26 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:27.105736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:27.107384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:27.178787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b0e939-fa8c-426e-9194-518ed67df0d4 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:27.184179 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:27.184772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:27.185047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:27.185313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:27.192881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:27.194719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2c7373-d7e9-4ba9-aa80-6313164cf11b service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:27.204375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1166/2349] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:27.405356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:27.466621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e88879-503e-41a0-a8d4-54a68f0b5a0f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:27.471475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:27.472158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:27.472434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:27.472703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] PATH_INFO: `/v3/users/0c958036e9814f0f89d6bd34a68be5ea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:27.473875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c958036e9814f0f89d6bd34a68be5ea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:27.475812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:27.521822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c958036e9814f0f89d6bd34a68be5ea'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:27.522462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c958036e9814f0f89d6bd34a68be5ea'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:27.523060 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c958036e9814f0f89d6bd34a68be5ea'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:27.530095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c958036e9814f0f89d6bd34a68be5ea'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:27.539996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=3,keystone:SELECT=89,keystone:DELETE=8 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:27.542450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c958036e9814f0f89d6bd34a68be5ea'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:27.556535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1184/2350] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:27 2022] DELETE /identity/v3/users/0c958036e9814f0f89d6bd34a68be5ea => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:27.561334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:27.561905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:27.562029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:27.581358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:27.582541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:27.639376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1167/2351] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:27.649100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:27.650490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:27.706306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56ccb90-51bd-4260-ad29-1048feeb2378 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:27.709779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:27.710375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:27.710647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:27.710934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:27.719665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:27.721106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957e035c-2a88-4c75-96ec-a3816130ba80 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:27.730757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1185/2352] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:27.991971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:27.994234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:28.005969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18222a4-b5d9-4e05-80df-e08da0193975 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.011169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.012776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.013391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.013669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] PATH_INFO: `/v3/projects/ce541813a9e34591ae74698fa94e757c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.015004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce541813a9e34591ae74698fa94e757c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.017979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.062059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:28.069126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce541813a9e34591ae74698fa94e757c', 'request_id': 'req-4bc5f93d-a31a-4317-9d8b-312d680b08f1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:28.075333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce541813a9e34591ae74698fa94e757c', 'request_id': 'req-4bc5f93d-a31a-4317-9d8b-312d680b08f1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:28.080918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce541813a9e34591ae74698fa94e757c', 'request_id': 'req-4bc5f93d-a31a-4317-9d8b-312d680b08f1'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:28.093514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] The token cache is being invalidate because project ce541813a9e34591ae74698fa94e757c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:28.093800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:28.094436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4bc5f93d-a31a-4317-9d8b-312d680b08f1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:28.096039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1168/2353] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:27 2022] DELETE /identity/v3/projects/ce541813a9e34591ae74698fa94e757c => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:28.101011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.101317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.102187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.121223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:28.122399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:28.181034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1186/2354] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:28.190195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.190505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.190777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.210398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:28.212149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:28.219936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1169/2355] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:28.224088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.234127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43be2ec8-8640-4dc9-8571-9d44f3262fb7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.238620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.239148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.239421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.239998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.240633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:58:28.240928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.242571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.254016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1187/2356] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:58:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:58:28.258112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.267372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cbe7252-54f5-40b2-809c-98a95b2658e0 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.272070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.272662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.272936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.273203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.274358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.276273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.303326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1170/2357] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/projects => generated 353 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:58:28.307360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.317054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ac8c10-93b6-43ad-ada4-ef4a6c08f491 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.370933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.371522 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.371824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.372094 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.372717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.374618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.395257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1188/2358] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/users => generated 277 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:28.399973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.409948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622431d-9e6a-456a-b204-4ec608661a1a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.414438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.415024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.415297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.415567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.416238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.417813 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.427309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1171/2359] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:58:28.431155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.447090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a1678-8243-40e2-aaf1-70c6f7beb9db admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.451993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.452623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.452898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.453166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.453808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.455402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-028b8545-100b-442f-9e23-05c062f7ab30 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.456840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:28.471720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1189/2360] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:28.472935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.482795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d88ea9-d541-4d85-a329-0e31ecf21281 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.487410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.488095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.488371 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.488704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] PATH_INFO: `/v3/projects/4db4f02aecb54d5d8af4d5e0b53346b4/users/41492f574e344ce5a310b9ba99aaf993/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.502770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4db4f02aecb54d5d8af4d5e0b53346b4, user_id=41492f574e344ce5a310b9ba99aaf993, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.505463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.519297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1172/2361] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:28 2022] PUT /identity/v3/projects/4db4f02aecb54d5d8af4d5e0b53346b4/users/41492f574e344ce5a310b9ba99aaf993/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:28.530099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.530411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.530707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.558750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] MFA Rules not processed for user `41492f574e344ce5a310b9ba99aaf993`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:28.559984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:28.621915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1190/2362] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:28.626410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.686877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fee24b-9e3f-4de3-9c64-b05cb600d73e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.691406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.692009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.692301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.692553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.693221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.695696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.722349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1173/2363] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/projects => generated 355 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:28.726406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.736893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37612c-1fac-4400-b3a0-ab3e0585fa8b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.791642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.792201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.792477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.792742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.793371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.795272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.816864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1191/2364] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:28 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:58:28.821030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.831088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc79dada-3cdb-40e8-a2b5-9678d3d94521 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.835571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.836226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.836499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.836768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.837409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.839245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.849462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1174/2365] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:28.853492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.865848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3dbbc1-971b-4660-813d-abba8a4d4aa5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.872078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.873143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.873753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.874036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] PATH_INFO: `/v3/projects/dac4432945da4e0c826070199e02cb97/users/50113907bc654f81b33a2dbb87e8f9ab/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.890014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac4432945da4e0c826070199e02cb97, user_id=50113907bc654f81b33a2dbb87e8f9ab, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.892704 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.905327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1192/2366] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:28 2022] PUT /identity/v3/projects/dac4432945da4e0c826070199e02cb97/users/50113907bc654f81b33a2dbb87e8f9ab/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:28.909255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:28.918999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec52638e-3595-4eb9-915d-ef64fbd0ec6a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:28.957750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:28.977388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:28.977997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:28.978275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:28.978545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:28.979180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:28.980809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0344938-5d57-465e-aec3-def0fed4b3e0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:28.990493 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1175/2367] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:28 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:58:28.995279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:29.006464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f48781-89a5-4594-9b34-606efa0b7a27 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:29.012303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:29.012999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:29.013276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:29.013543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] PATH_INFO: `/v3/projects/dac4432945da4e0c826070199e02cb97/users/50113907bc654f81b33a2dbb87e8f9ab/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:29.015472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dac4432945da4e0c826070199e02cb97, user_id=50113907bc654f81b33a2dbb87e8f9ab, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:29.018112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:29.028345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1193/2368] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:28 2022] PUT /identity/v3/projects/dac4432945da4e0c826070199e02cb97/users/50113907bc654f81b33a2dbb87e8f9ab/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:58:29.038501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:29.038779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:29.039431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:29.067377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] MFA Rules not processed for user `50113907bc654f81b33a2dbb87e8f9ab`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:29.068516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:29.140192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1176/2369] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:29 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:29.151383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:29.153086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:29.194958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:29.210655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a6a05e-97fe-4883-8c89-84c83c2f4e2a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:29.214328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:29.214918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:29.215189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:29.215453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:29.224178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:29.225590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:29.235163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1194/2370] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:29 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:29.309347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:29.318927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8329898d-a1ec-4991-8231-6bcdfbf7dde8 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:29.322507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:29.323098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:29.323374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:29.323646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:29.379266 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:29.380700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5390ee2-d9e1-4e2e-9f49-bba34540bb60 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:29.389540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1177/2371] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:29 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:39.231114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=9 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:39.385597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=73 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:44.275741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:44.336183 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf7e475-0d2e-4d96-aae6-ab35bcddd7a0 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:44.341221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:44.341844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:44.342119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:44.342388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] PATH_INFO: `/v3/users/41492f574e344ce5a310b9ba99aaf993` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:44.343521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41492f574e344ce5a310b9ba99aaf993)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:44.345450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:44.390041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41492f574e344ce5a310b9ba99aaf993'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:44.390674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41492f574e344ce5a310b9ba99aaf993'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:44.391280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41492f574e344ce5a310b9ba99aaf993'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:44.398143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41492f574e344ce5a310b9ba99aaf993'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:44.410191 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41492f574e344ce5a310b9ba99aaf993'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:44.423005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1195/2372] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:44 2022] DELETE /identity/v3/users/41492f574e344ce5a310b9ba99aaf993 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:44.427482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:44.427993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:44.428084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:44.447349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:44.449168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:44.505839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1178/2373] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:44.516427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:44.517754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:44.574329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a7f982-a664-4f47-9c58-625d0f617012 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:44.577944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:44.578544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:44.578823 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:44.579093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:44.587919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:44.589388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:44.598554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1196/2374] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:45.092191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:45.093691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:45.106242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f18e836-c3b3-48be-b7f3-4cbaf7616e5e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:45.110838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:45.111472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.111776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.112050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] PATH_INFO: `/v3/projects/4db4f02aecb54d5d8af4d5e0b53346b4` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.113260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4db4f02aecb54d5d8af4d5e0b53346b4)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:45.115417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:45.162040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4db4f02aecb54d5d8af4d5e0b53346b4', 'request_id': 'req-640f6547-6865-4dda-82f7-8d70e06e8fd6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.168688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4db4f02aecb54d5d8af4d5e0b53346b4', 'request_id': 'req-640f6547-6865-4dda-82f7-8d70e06e8fd6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.174307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4db4f02aecb54d5d8af4d5e0b53346b4', 'request_id': 'req-640f6547-6865-4dda-82f7-8d70e06e8fd6'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.186362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] The token cache is being invalidate because project 4db4f02aecb54d5d8af4d5e0b53346b4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:45.186652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.187276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.188786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1179/2375] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:45 2022] DELETE /identity/v3/projects/4db4f02aecb54d5d8af4d5e0b53346b4 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:45.192919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:45.202754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac976f95-d72f-41b4-9cd1-3337ffa5cf4d service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:45.222563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:45.261676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:45.262299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.262577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.262849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] PATH_INFO: `/v3/users/50113907bc654f81b33a2dbb87e8f9ab` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.264000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50113907bc654f81b33a2dbb87e8f9ab)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:45.265921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:45.311406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50113907bc654f81b33a2dbb87e8f9ab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.312372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50113907bc654f81b33a2dbb87e8f9ab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.312996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50113907bc654f81b33a2dbb87e8f9ab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.319991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50113907bc654f81b33a2dbb87e8f9ab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.331498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-603a236b-c1b7-460e-b740-0c417a3efae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50113907bc654f81b33a2dbb87e8f9ab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.344478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1197/2376] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:45 2022] DELETE /identity/v3/users/50113907bc654f81b33a2dbb87e8f9ab => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:58:45.607891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:45.609454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:45.627782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640f6547-6865-4dda-82f7-8d70e06e8fd6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:45.691204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:45.691866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.692147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.692422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] PATH_INFO: `/v3/projects/dac4432945da4e0c826070199e02cb97` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.693564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] RBAC: Authorizing `identity:delete_project(project_id=dac4432945da4e0c826070199e02cb97)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:45.695459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:45.728711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:45.745645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dac4432945da4e0c826070199e02cb97', 'request_id': 'req-07dfca32-782e-4d2f-9768-568db1a8917a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.751677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dac4432945da4e0c826070199e02cb97', 'request_id': 'req-07dfca32-782e-4d2f-9768-568db1a8917a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.757195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dac4432945da4e0c826070199e02cb97', 'request_id': 'req-07dfca32-782e-4d2f-9768-568db1a8917a'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.769641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] The token cache is being invalidate because project dac4432945da4e0c826070199e02cb97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:45.769930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.770564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-07dfca32-782e-4d2f-9768-568db1a8917a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:45.772053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1180/2377] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:45 2022] DELETE /identity/v3/projects/dac4432945da4e0c826070199e02cb97 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:45.777496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.777781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.778054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.797148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:45.798346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:45.856711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1198/2378] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:45.864452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.864737 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.865018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.884444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:45.885641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:45.893903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1181/2379] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:45.897892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:45.907953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511c8bde-84c7-445e-a84b-15961c6a6424 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:45.912443 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:45.913030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.913306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.913576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.914207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:58:45.914504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:45.916162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:45.927357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1199/2380] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:58:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:58:45.931422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:45.941098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df50c12d-83bf-4679-a052-67327a5cee55 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:45.945764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:45.946353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:45.946633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:45.946904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:45.947529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:45.950086 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:45.976330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1182/2381] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:45 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:45.983956 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:46.002268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3267dae6-20a5-495d-b8c7-a27930d913eb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:46.034724 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:46.077434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:46.078041 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.078314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.078585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.079226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:46.081174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:46.101175 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1200/2382] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:45 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:46.105199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:46.115597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414e1d4a-fd35-492c-a0cb-a7b59e8648f6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:46.120665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:46.121267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.121533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.121807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.122479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:46.124105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:46.134112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1183/2383] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:46.138498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:46.148273 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d6a7f0-889a-40ba-a10c-d51af1471dd7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:46.152827 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:46.153412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.153692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.153964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.154607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:46.156224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85088e5-6a02-4342-a44c-34b9f6deb7c0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:46.166561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1201/2384] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:46.170705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:46.180488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c3b478-6b53-4120-9c1c-03701d5928bf admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:46.185665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:46.186295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.186569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.186839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] PATH_INFO: `/v3/projects/93b1d04674b2415fa05edbaa4cd8f084/users/e0bccbe52d594b419151512bcd506b92/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.203109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=93b1d04674b2415fa05edbaa4cd8f084, user_id=e0bccbe52d594b419151512bcd506b92, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:46.205752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:46.218055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1184/2385] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:46 2022] PUT /identity/v3/projects/93b1d04674b2415fa05edbaa4cd8f084/users/e0bccbe52d594b419151512bcd506b92/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:58:46.228137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.228420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.228690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.255944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] MFA Rules not processed for user `e0bccbe52d594b419151512bcd506b92`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:46.257136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:46.321388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1202/2386] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:46.332079 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:46.333808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:46.391827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f333e0e7-07bc-49cc-9583-b91f1a6b5de9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:46.395386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:46.396017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:46.396295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:46.396561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:46.405437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:46.406861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b28945-42a4-4ac3-95fc-febfa5f5ee52 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:46.415605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1185/2387] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:46 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:51.712196 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:51.772738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595dcf5b-083e-49a1-be32-642ced75bc3e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:51.777193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:51.777810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:51.778087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:51.778358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] PATH_INFO: `/v3/users/e0bccbe52d594b419151512bcd506b92` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:51.779460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0bccbe52d594b419151512bcd506b92)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:51.781412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:51.821014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:51.828534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0bccbe52d594b419151512bcd506b92'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:51.829398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0bccbe52d594b419151512bcd506b92'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:51.830045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0bccbe52d594b419151512bcd506b92'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:51.837067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0bccbe52d594b419151512bcd506b92'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:51.848746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0bccbe52d594b419151512bcd506b92'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:51.861423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1203/2388] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:51 2022] DELETE /identity/v3/users/e0bccbe52d594b419151512bcd506b92 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:51.866008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:51.866467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:51.866587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:51.886050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:51.887249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:51.932914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=6,keystone:SELECT=91,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:51.947907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1186/2389] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:51.957653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:51.959040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:52.021475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8279c260-53c4-429b-93ae-759fe1456c6c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.027609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.028442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.028560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.028789 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.038234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.039656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4958578-b798-49fa-addc-02a1934c3578 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.049649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1204/2390] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:52.320431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.321905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:52.341322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b3429c-d040-4b70-abd1-389d2596ecdb None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.345953 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.346674 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.346986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.347292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] PATH_INFO: `/v3/projects/93b1d04674b2415fa05edbaa4cd8f084` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.348433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=93b1d04674b2415fa05edbaa4cd8f084)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.350447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.396636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '93b1d04674b2415fa05edbaa4cd8f084', 'request_id': 'req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:52.403207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '93b1d04674b2415fa05edbaa4cd8f084', 'request_id': 'req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:52.408710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '93b1d04674b2415fa05edbaa4cd8f084', 'request_id': 'req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:52.420858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] The token cache is being invalidate because project 93b1d04674b2415fa05edbaa4cd8f084 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:52.421147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:52.421767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5a47eb0c-5bc8-4768-b6a5-42b890e12d5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:52.423224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1187/2391] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:52 2022] DELETE /identity/v3/projects/93b1d04674b2415fa05edbaa4cd8f084 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:52.428158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.428446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.428746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.448002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:52.449736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:52.507333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1205/2392] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:52.517088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.517375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.517655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.537698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:52.538907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:52.546670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1188/2393] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:52.550900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.560382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b423f6d-779e-4a29-ba1d-941c8e994144 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.564875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.565493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.565771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.566042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.566674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:58:52.566973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.568588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.580284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1206/2394] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:58:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:58:52.584345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.593980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01cb37ce-31dd-4f8b-9578-1f5f428d82e5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.598574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.599171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.599449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.599719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.600373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.602254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.629696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1189/2395] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:52 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:52.634102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.644820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdc9d14-80ea-4a75-a3c8-902993b25d8e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.694215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:52.709321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.709927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.710204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.710473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.711107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.713103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.733227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1207/2396] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:52 2022] POST /identity/v3/users => generated 288 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:52.737415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.748137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d00cb58e-bb16-4a3a-8daf-454176db807d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.752639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.753226 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.753498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.753764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.754395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.756008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.766625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1190/2397] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:52.770370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.780174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3489287-bcef-4e8e-b78e-cf54b676dcee admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.784743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.785322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.785598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.785867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.786496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.788120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df21c1c-d499-4c4d-941a-b414a4c442d0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.798364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1208/2398] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:52 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:58:52.802168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.812468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562c5e2a-dc53-4840-b993-2e47ddcdf9b2 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:52.817075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:52.817707 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.817986 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.818260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] PATH_INFO: `/v3/projects/6c30d48a72d7469db0383dc2b0e3d96b/users/26cd431876d44b698588a4ea439c1517/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.833050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c30d48a72d7469db0383dc2b0e3d96b, user_id=26cd431876d44b698588a4ea439c1517, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:52.835673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:52.847643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1191/2399] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:52 2022] PUT /identity/v3/projects/6c30d48a72d7469db0383dc2b0e3d96b/users/26cd431876d44b698588a4ea439c1517/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:52.857741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:52.858023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:52.858292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:52.888121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] MFA Rules not processed for user `26cd431876d44b698588a4ea439c1517`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:52.889327 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:52.956676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1209/2400] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:52 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:52.967447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:52.969212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:53.029236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4b3bbd-f1c4-45d4-b1b1-ff932f4f6bc7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:53.032822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:53.033421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:53.033697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:53.033968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:53.042347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:53.044434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd8290e-4e60-45e8-a61a-0bb30b899604 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:53.053137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1192/2401] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:52 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:56.051826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.113977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b60de-782c-41a6-b22b-62953e2ffd90 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:56.118813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:56.119433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.119708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.120011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] PATH_INFO: `/v3/users/26cd431876d44b698588a4ea439c1517` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.121116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=26cd431876d44b698588a4ea439c1517)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:56.123026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:56.169560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26cd431876d44b698588a4ea439c1517'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.170517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26cd431876d44b698588a4ea439c1517'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.171465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26cd431876d44b698588a4ea439c1517'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.179421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26cd431876d44b698588a4ea439c1517'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.180553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:56.193221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26cd431876d44b698588a4ea439c1517'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.206266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1210/2402] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:58:56 2022] DELETE /identity/v3/users/26cd431876d44b698588a4ea439c1517 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:56.210836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.211308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.211416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.230918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:56.232143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:56.241299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:56.292738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1193/2403] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:56.302616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.310483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:56.369478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07faf987-3013-42bd-b5cc-2061ea4b6ff6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:56.373134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:56.373726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.373999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.374264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.383015 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:56.384714 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9526e-2923-46d3-9a62-c4103f5623cf service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:56.394639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1211/2404] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:56.655792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.657197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:56.674148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd94cc15-4cfa-46d0-a1a4-fb0c96d2d355 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:56.679643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:56.680790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.681307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.681844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] PATH_INFO: `/v3/projects/6c30d48a72d7469db0383dc2b0e3d96b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.683557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c30d48a72d7469db0383dc2b0e3d96b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:56.685524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:56.731522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c30d48a72d7469db0383dc2b0e3d96b', 'request_id': 'req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.737702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c30d48a72d7469db0383dc2b0e3d96b', 'request_id': 'req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.743182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c30d48a72d7469db0383dc2b0e3d96b', 'request_id': 'req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.755841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] The token cache is being invalidate because project 6c30d48a72d7469db0383dc2b0e3d96b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:58:56.756129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.756783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4d0b5e46-25c1-40ff-9462-e62cf70ddbff admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:58:56.758297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1194/2405] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:58:56 2022] DELETE /identity/v3/projects/6c30d48a72d7469db0383dc2b0e3d96b => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:56.764017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.764301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.764566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.783354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:56.784503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:56.842125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1212/2406] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:56.849705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.849991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.850268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.870015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:56.871863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:56.879555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1195/2407] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:56.883629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.893376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15697b31-0628-4ea4-b2fc-b79103ed18e7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:56.897854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:56.898447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.898725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.898998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.899635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:58:56.899975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:56.901568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:56.912717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1213/2408] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:58:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:58:56.916910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.926472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583c99ad-8a58-454c-8289-e0eb231754a4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:56.931070 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:56.931651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:56.931963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:56.932235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:56.932878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:56.935383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:56.967340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1196/2409] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:56 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:58:56.971763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:56.982084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db3bb5e-4fd4-4289-8517-4eb1afeb1d6e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.036432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.036946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.037224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.037511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.038126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.040064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.050351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:57.062953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1214/2410] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:56 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:57.067019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.077300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e327d5-55de-4012-bb33-3442664c2847 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.081902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.082498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.082779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.083057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.083721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.085367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.095133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1197/2411] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:57.098750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.109031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65aec0d-0bba-48a3-bae5-4db9e1bec780 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.113611 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.114201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.114483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.114758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.115395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.117027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc20ace2-617a-4528-bfcf-1a98bd99c289 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.127998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1215/2412] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:57.131914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.141790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ac0391-0ecb-4086-8dba-5009003e77c8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.146301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.146931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.147202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.147470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] PATH_INFO: `/v3/projects/b5c1116e22644f859c59b5cfe68d557e/users/c777f62c8ca7421cb73fd29972f03c54/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.162011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b5c1116e22644f859c59b5cfe68d557e, user_id=c777f62c8ca7421cb73fd29972f03c54, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.164662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.177665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1198/2413] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:57 2022] PUT /identity/v3/projects/b5c1116e22644f859c59b5cfe68d557e/users/c777f62c8ca7421cb73fd29972f03c54/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:58:57.188809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.189089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.189386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.217231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] MFA Rules not processed for user `c777f62c8ca7421cb73fd29972f03c54`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:57.218429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:57.280954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1216/2414] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:57.285643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.324860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:57.349580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b813ed-95d4-4878-ad5f-6727e3812475 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.354148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.355343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.355634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.355936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.356560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.358433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.383554 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1199/2415] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:57.387887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.398440 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285e6a92-77b6-4861-a8cc-c039f8f1d10f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.456897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.457508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.457781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.458049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.458680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.460621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.482187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1217/2416] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:58:57.486133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.496803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a4bd6f-bce6-448c-89a1-e2c80ab1bdce admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.501291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.501877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.502148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.502415 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.503067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.504678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.515687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1200/2417] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:57.519527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.529668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d6b1b5-3a1d-4c73-af2f-77a1d96db76d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.534298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.534927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.535203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.535472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.536148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.537726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d47b7321-59da-45c4-af7f-59ba946cb6f1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.548008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1218/2418] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:57.551890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.562135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01801a73-a160-4967-9b1f-7c59267907e2 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.566698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.567324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.567598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.567904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] PATH_INFO: `/v3/projects/02f295a2550640eaa3e025e6deb75606/users/1dceda725fee42f4a674c0c2b742d443/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.582241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02f295a2550640eaa3e025e6deb75606, user_id=1dceda725fee42f4a674c0c2b742d443, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.584928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.597588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1201/2419] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:57 2022] PUT /identity/v3/projects/02f295a2550640eaa3e025e6deb75606/users/1dceda725fee42f4a674c0c2b742d443/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:57.608230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.608525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.608824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.637892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] MFA Rules not processed for user `1dceda725fee42f4a674c0c2b742d443`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:57.639100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:57.677540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:57.701703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1219/2420] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:57.706222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.766912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97b4578-7a71-4f5d-a271-101bc26adf48 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.771458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.772075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.772350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.772619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.773238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.775103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.800718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1202/2421] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/projects => generated 385 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:57.804875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.816307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97ed923-a5e8-4a35-b798-30f492c7ccd7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.871292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.871841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.872117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.872384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.873004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.874904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.895143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1220/2422] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:58:57 2022] POST /identity/v3/users => generated 299 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:58:57.899198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.909713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc22b0b5-938e-4085-9fe9-203b92d6e08a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.914262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.914855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.915129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.915396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.916063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.918292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.928576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1203/2423] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:58:57.932444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.942048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c39499e6-b686-48ea-a8c2-7c4c29824081 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:57.946624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:57.947275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:57.947548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:57.947860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] PATH_INFO: `/v3/projects/5164eb1ed1774433995b29e8b37dd0c1/users/727d28c64a754af99346ac862e07983b/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:57.962003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5164eb1ed1774433995b29e8b37dd0c1, user_id=727d28c64a754af99346ac862e07983b, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:57.965203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:57.977521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1221/2424] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:57 2022] PUT /identity/v3/projects/5164eb1ed1774433995b29e8b37dd0c1/users/727d28c64a754af99346ac862e07983b/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:57.981886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:57.991583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7642d1e-a036-418f-bc2a-a5b157d8afc2 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:58.047304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:58.047930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:58.048209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:58.048480 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:58.049110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:58.050682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123de5aa-205c-4865-b436-b0fe75b2a3f7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:58.051895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:58.061624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1204/2425] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:58:57 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:58:58.065684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:58.075803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b200da9-24cd-4437-bedb-e953c16824a4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:58.080314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:58.080945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:58.081218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:58.081483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] PATH_INFO: `/v3/projects/5164eb1ed1774433995b29e8b37dd0c1/users/727d28c64a754af99346ac862e07983b/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:58.083330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5164eb1ed1774433995b29e8b37dd0c1, user_id=727d28c64a754af99346ac862e07983b, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:58.085953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:58.096484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1222/2426] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:58:58 2022] PUT /identity/v3/projects/5164eb1ed1774433995b29e8b37dd0c1/users/727d28c64a754af99346ac862e07983b/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:58:58.107839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:58.108165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:58.108422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:58.135532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] MFA Rules not processed for user `727d28c64a754af99346ac862e07983b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:58:58.136713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:58.203798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1205/2427] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:58:58 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:58:58.215466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:58.217267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:58.273712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa77d1-c47d-43c1-81b9-686ab8dd0d66 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:58.277874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:58.278465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:58.278737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:58.279003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:58.320730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:58:58.333650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:58.335058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:58.344319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1223/2428] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:58 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:58:59.845786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:58:59.847244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:58:59.858853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c88f99-1a61-4165-9fee-ad5f9f97945f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:58:59.862821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:58:59.863428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:58:59.863703 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:58:59.864006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:58:59.919442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:58:59.920898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:58:59.929585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1206/2429] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:58:59 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:00.459346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:00.468047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7aa52b-ed50-4f5d-8643-5c123d723e4c service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:00.471656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:00.472284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:00.472561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:00.472831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:00.481630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:00.483035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d1e05b-ed6c-4f5e-bcca-eaf57404f0c7 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:00.492210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1224/2430] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:00 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:04.361377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:04.422671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ad5041-0831-417b-9635-fd2eb8c0db44 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:04.427206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:04.427849 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:04.428128 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:04.428401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] PATH_INFO: `/v3/users/c777f62c8ca7421cb73fd29972f03c54` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:04.429509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c777f62c8ca7421cb73fd29972f03c54)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:04.431441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:04.454817 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:04.478893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c777f62c8ca7421cb73fd29972f03c54'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:04.479533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c777f62c8ca7421cb73fd29972f03c54'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:04.480178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c777f62c8ca7421cb73fd29972f03c54'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:04.496894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c777f62c8ca7421cb73fd29972f03c54'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:04.503669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c777f62c8ca7421cb73fd29972f03c54'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:04.517280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1207/2431] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:59:04 2022] DELETE /identity/v3/users/c777f62c8ca7421cb73fd29972f03c54 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:04.521915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:04.522404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:04.522499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:04.541680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:04.542924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:04.600100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1225/2432] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:04.609604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:04.611005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:04.668433 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76360f26-1a14-4c73-be73-dafefa9482d7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:04.672022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:04.672615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:04.672888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:04.673154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:04.681882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:04.683826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:04.692973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1208/2433] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:04.951654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:04.953178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:04.966463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587d0dc0-631d-4803-a986-2e29d00129c4 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:04.971258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:04.971929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:04.972210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:04.972480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] PATH_INFO: `/v3/projects/b5c1116e22644f859c59b5cfe68d557e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:04.973607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b5c1116e22644f859c59b5cfe68d557e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:04.976040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:05.024326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b5c1116e22644f859c59b5cfe68d557e', 'request_id': 'req-5d1a07d2-cd28-4964-97db-fa1965b11bf8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.031313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b5c1116e22644f859c59b5cfe68d557e', 'request_id': 'req-5d1a07d2-cd28-4964-97db-fa1965b11bf8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.037547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b5c1116e22644f859c59b5cfe68d557e', 'request_id': 'req-5d1a07d2-cd28-4964-97db-fa1965b11bf8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.048192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] The token cache is being invalidate because project b5c1116e22644f859c59b5cfe68d557e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:59:05.048475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.049099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.050554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1226/2434] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:59:04 2022] DELETE /identity/v3/projects/b5c1116e22644f859c59b5cfe68d557e => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:05.054481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:05.064474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b114e0-f122-4890-9cf9-75269081ea2b service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:05.123414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:05.124081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:05.124355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:05.124621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] PATH_INFO: `/v3/users/1dceda725fee42f4a674c0c2b742d443` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:05.125731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dceda725fee42f4a674c0c2b742d443)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:05.127748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:05.169456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:05.172447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dceda725fee42f4a674c0c2b742d443'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.173134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dceda725fee42f4a674c0c2b742d443'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.173873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dceda725fee42f4a674c0c2b742d443'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.187085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dceda725fee42f4a674c0c2b742d443'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.193891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dceda725fee42f4a674c0c2b742d443'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.206267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1209/2435] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:59:05 2022] DELETE /identity/v3/users/1dceda725fee42f4a674c0c2b742d443 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:05.465356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:05.466746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:05.479461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1a07d2-cd28-4964-97db-fa1965b11bf8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:05.531980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:05.539272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:05.540566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:05.540942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:05.541243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] PATH_INFO: `/v3/projects/02f295a2550640eaa3e025e6deb75606` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:05.543243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02f295a2550640eaa3e025e6deb75606)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:05.545314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:05.590665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02f295a2550640eaa3e025e6deb75606', 'request_id': 'req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.597778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02f295a2550640eaa3e025e6deb75606', 'request_id': 'req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.603805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02f295a2550640eaa3e025e6deb75606', 'request_id': 'req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.614371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] The token cache is being invalidate because project 02f295a2550640eaa3e025e6deb75606 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:59:05.614657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.615339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.616908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1227/2436] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:59:05 2022] DELETE /identity/v3/projects/02f295a2550640eaa3e025e6deb75606 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:05.620815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:05.622186 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:05.634733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d7fac0-f107-41a6-9a49-367708a83e54 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:05.692717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:05.693345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:05.693623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:05.693897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] PATH_INFO: `/v3/users/727d28c64a754af99346ac862e07983b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:05.695009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=727d28c64a754af99346ac862e07983b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:05.696990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:05.741533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '727d28c64a754af99346ac862e07983b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.742164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '727d28c64a754af99346ac862e07983b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.742782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '727d28c64a754af99346ac862e07983b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.754806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '727d28c64a754af99346ac862e07983b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.762388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ec364511-ab00-42b8-b515-1eff11b39a49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '727d28c64a754af99346ac862e07983b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:05.774317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1210/2437] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:59:05 2022] DELETE /identity/v3/users/727d28c64a754af99346ac862e07983b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:06.040709 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.042658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:06.055298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd67bf-7e40-493d-a4bb-d9cb745ec095 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.112126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.112753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.113035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.113306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] PATH_INFO: `/v3/projects/5164eb1ed1774433995b29e8b37dd0c1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.114418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5164eb1ed1774433995b29e8b37dd0c1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.116370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.161858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5164eb1ed1774433995b29e8b37dd0c1', 'request_id': 'req-e54611f1-c613-44c6-9916-b2071b052cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:06.169316 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5164eb1ed1774433995b29e8b37dd0c1', 'request_id': 'req-e54611f1-c613-44c6-9916-b2071b052cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:06.175760 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5164eb1ed1774433995b29e8b37dd0c1', 'request_id': 'req-e54611f1-c613-44c6-9916-b2071b052cc6'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:06.185844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] The token cache is being invalidate because project 5164eb1ed1774433995b29e8b37dd0c1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:59:06.186125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:06.186748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e54611f1-c613-44c6-9916-b2071b052cc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:06.188237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1228/2438] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:59:06 2022] DELETE /identity/v3/projects/5164eb1ed1774433995b29e8b37dd0c1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:06.193018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.193301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.193568 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.213163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:06.214851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:06.247256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:06.274238 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1211/2439] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:06.282698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.282984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.283261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.303081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:06.304334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:06.312614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1229/2440] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:06.316537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.326284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7488fe-02c1-42f2-bbab-b72b6efa1753 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.330796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.331390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.331671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.331981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.332627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:59:06.332933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.334556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.346482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1212/2441] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:59:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 04:59:06.350614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.360318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9299c4d-9449-4b70-9dab-bcbb2476692b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.364887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.365477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.365756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.366028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.366662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.368590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.377978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:06.396634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1230/2442] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:59:06 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:59:06.400604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.410984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21963d29-2cc7-437c-a5db-1988bb053432 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.467572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.468232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.468510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.468778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.469410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.471316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.492306 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1213/2443] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:59:06 2022] POST /identity/v3/users => generated 285 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:59:06.496275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.506581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e569283-b5b1-4df6-a454-73a21e8e00b1 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.512231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.512858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.513134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.513429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.514062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.515743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.525587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1231/2444] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:59:06.529880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.539495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daef5a30-183e-42ca-9086-aa84e6bb21d8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.544267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.544846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.545122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.545384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.546014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.547607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0735b57b-d66e-46eb-b0e3-53ac272c7448 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.558025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1214/2445] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:59:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 04:59:06.562013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.572028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239859e-9683-49e0-880f-32a0ebffdfd4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.577374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.578022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.578304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.578577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] PATH_INFO: `/v3/projects/42c4907fddad4d808f28ada8c8d74f8e/users/caa2e994187e456bb1df40d430fdf0c5/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.593598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42c4907fddad4d808f28ada8c8d74f8e, user_id=caa2e994187e456bb1df40d430fdf0c5, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.596293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.609289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1232/2446] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:59:06 2022] PUT /identity/v3/projects/42c4907fddad4d808f28ada8c8d74f8e/users/caa2e994187e456bb1df40d430fdf0c5/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:06.619452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1d9b-5d06-48fc-b550-3935d69d5754 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.619754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1d9b-5d06-48fc-b550-3935d69d5754 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.620042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fd1d9b-5d06-48fc-b550-3935d69d5754 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.648063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-63fd1d9b-5d06-48fc-b550-3935d69d5754 None None] MFA Rules not processed for user `caa2e994187e456bb1df40d430fdf0c5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:06.649301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-63fd1d9b-5d06-48fc-b550-3935d69d5754 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:06.710789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1215/2447] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:06 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:06.723558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:06.725252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:06.780001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b111a-89ce-468c-aebc-26c75358b5d2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:06.783455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:06.784074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:06.784349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:06.784614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:06.792579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:06.793973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:06.802403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1233/2448] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:06 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:16.707922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:16.798588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=45,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:26.179886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:26.180323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:26.180440 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:26.202387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] MFA Rules not processed for user `c32d9ea3c6a44d15b2b050e99524b56e`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:26.203666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:26.257201 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1216/2449] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:36.250649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=25 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:37.129834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:37.131268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:37.188393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0047e60e-fc7d-44a5-96e7-1c6e60339267 service glance] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:37.192075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:37.192600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:37.192895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:37.193224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:37.194988 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:37.256310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:37.257809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df89364-34de-4a67-8082-99964d4b9c78 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:37.268185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1234/2450] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:38.141449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:38.203321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1e4f01-545d-4cf0-90cf-dfc6177cc456 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:38.208272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:38.208893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.209170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.209437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] PATH_INFO: `/v3/users/caa2e994187e456bb1df40d430fdf0c5` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.210527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] RBAC: Authorizing `identity:delete_user(user_id=caa2e994187e456bb1df40d430fdf0c5)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:38.212439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:38.257511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'caa2e994187e456bb1df40d430fdf0c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.258416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'caa2e994187e456bb1df40d430fdf0c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.259018 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'caa2e994187e456bb1df40d430fdf0c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.271414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'caa2e994187e456bb1df40d430fdf0c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.279330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'caa2e994187e456bb1df40d430fdf0c5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.291816 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1217/2451] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 04:59:38 2022] DELETE /identity/v3/users/caa2e994187e456bb1df40d430fdf0c5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:38.296374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.296881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.296978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.317708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:38.318915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:38.375786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1235/2452] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:38.385660 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:38.387886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:38.450650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e682d38-8538-49f6-bb6d-27821095d966 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:38.454263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:38.454896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.455168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.455435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.464602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:38.466072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91ca4bd-f6d9-4a1d-8ad4-0039606c5f4d service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:38.475682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1218/2453] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:38.743649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:38.745120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:38.759693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fa7686-e71f-44e0-8ae1-f4cfa3ccc4ee None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:38.764626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:38.765271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.765546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.765819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] PATH_INFO: `/v3/projects/42c4907fddad4d808f28ada8c8d74f8e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.766947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] RBAC: Authorizing `identity:delete_project(project_id=42c4907fddad4d808f28ada8c8d74f8e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:38.769059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:38.819641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42c4907fddad4d808f28ada8c8d74f8e', 'request_id': 'req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.821470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:38.828728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42c4907fddad4d808f28ada8c8d74f8e', 'request_id': 'req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.835472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42c4907fddad4d808f28ada8c8d74f8e', 'request_id': 'req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.849218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] The token cache is being invalidate because project 42c4907fddad4d808f28ada8c8d74f8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 04:59:38.849509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.850154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-0e502f5f-0988-49eb-a5db-c9a2da8dc99b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 04:59:38.851652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1236/2454] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 04:59:38 2022] DELETE /identity/v3/projects/42c4907fddad4d808f28ada8c8d74f8e => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 04:59:38.858710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.858994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.859270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.879281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:38.880585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:38.911921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:38.951160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1219/2455] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:38.958748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:38.959034 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:38.959314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:38.979663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:38.981422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:38.989374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1237/2456] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:38.993459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.007012 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45ea344-9e19-413c-b983-74a2fcb02bf6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.015640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.016294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.016570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.016838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.017484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 04:59:39.017782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.019377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.035423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1220/2457] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 04:59:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 04:59:39.039162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.049505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3ce4e3-84f1-467a-9ce7-34d5b97a8dd2 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.054264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.054888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.055166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.055438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.056107 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.058010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.086708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1238/2458] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 04:59:39 2022] POST /identity/v3/projects => generated 363 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 04:59:39.092109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.104553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea325d9e-b639-4abd-a7bc-39f149905bfe admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.160362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.160981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.161153 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.161427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.162052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.164022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.185113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1221/2459] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 04:59:39 2022] POST /identity/v3/users => generated 282 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 04:59:39.189286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.199812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8408c118-09d5-4cc0-afd8-347529ea7330 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.205670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.206299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.206575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.206843 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.207477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.209086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.219403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1239/2460] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:59:39.223328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.235034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5849d0-8dd7-497a-9984-43a296718abd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.240511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.241345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.241664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.242040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.242676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.244297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-121fd2c5-4c97-49a6-9c11-e36854c0062d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.254706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1222/2461] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 04:59:39 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 04:59:39.259121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.268874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9f3c6a-af2e-4364-89c6-7b838d40b1e0 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.273702 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.274326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.274599 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.274867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] PATH_INFO: `/v3/projects/4bcb0cee5e184a57883e12c34ba648f6/users/aef47c8498cf44b1a1dc6d92537711e2/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.289869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bcb0cee5e184a57883e12c34ba648f6, user_id=aef47c8498cf44b1a1dc6d92537711e2, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.292649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.306573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1240/2462] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 04:59:39 2022] PUT /identity/v3/projects/4bcb0cee5e184a57883e12c34ba648f6/users/aef47c8498cf44b1a1dc6d92537711e2/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 04:59:39.316686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7458d-fe63-47e6-b837-97eaf1deec27 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.316871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7458d-fe63-47e6-b837-97eaf1deec27 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.317142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d7458d-fe63-47e6-b837-97eaf1deec27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.344787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-00d7458d-fe63-47e6-b837-97eaf1deec27 None None] MFA Rules not processed for user `aef47c8498cf44b1a1dc6d92537711e2`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:39.346020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-00d7458d-fe63-47e6-b837-97eaf1deec27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:39.411613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1223/2463] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:39 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:39.423268 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:39.425260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:39.488349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60841f8-e79f-4aba-a4fc-acb75d6da65c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:39.492089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:39.492696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:39.493032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:39.493419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:39.502113 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:39.503544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:39.514976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1241/2464] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:39 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:44.737949 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6aa73-2745-428a-92b6-16518618267a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:44.738494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6aa73-2745-428a-92b6-16518618267a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:44.738494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d6aa73-2745-428a-92b6-16518618267a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:44.757646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-15d6aa73-2745-428a-92b6-16518618267a None None] MFA Rules not processed for user `b94077b7a43c42b68f633afe3c9ce715`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 04:59:44.759084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-15d6aa73-2745-428a-92b6-16518618267a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:44.770275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:44.814656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1224/2465] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 04:59:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 04:59:45.114803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 04:59:45.116234 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:45.175046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71da525a-82ae-4774-9441-febd152989f8 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 04:59:45.178635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 04:59:45.179230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 04:59:45.179503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 04:59:45.179801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 04:59:45.181482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 04:59:45.190652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 04:59:45.192086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 04:59:45.199926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1242/2466] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 04:59:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 04:59:54.808500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=17 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 04:59:55.196673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=85 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:00.058091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:00.058625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:00.058744 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:00.084008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:00.085468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:00.170964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1225/2467] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:00:00 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:00.223458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:00.225686 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:00.318164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6debe34f-ed20-496b-ab3f-78157e2c52b5 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:00.324847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:00.325453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:00.325733 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:00.326005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:00.335540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:00.337146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0172486-b6af-4a15-98d7-e6b04cdec970 service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:00.354525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1243/2468] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:00:00 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:00:10.158607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=25 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:10.342952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=32 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:16.733672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:16.835543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb0bb7-f9dd-4551-895f-d06595a5bcf1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:16.840171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:16.840841 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:16.841120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:16.841394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] PATH_INFO: `/v3/users/aef47c8498cf44b1a1dc6d92537711e2` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:16.842524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aef47c8498cf44b1a1dc6d92537711e2)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:16.844462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:16.892196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aef47c8498cf44b1a1dc6d92537711e2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:16.892853 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aef47c8498cf44b1a1dc6d92537711e2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:16.893467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aef47c8498cf44b1a1dc6d92537711e2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:16.905316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aef47c8498cf44b1a1dc6d92537711e2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:16.912193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aef47c8498cf44b1a1dc6d92537711e2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:16.925133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1226/2469] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:00:16 2022] DELETE /identity/v3/users/aef47c8498cf44b1a1dc6d92537711e2 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:00:16.929746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:16.930280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:16.930280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:16.981834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:16.983064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:17.046683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1244/2470] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:00:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:17.056645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:17.058656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:17.105936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:17.148321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e990d2-84ed-425e-92a0-440a5a312f91 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:17.151489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:17.152517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:17.153325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:17.153325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:17.163575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:17.165515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056cf77d-c6dd-4f19-8bf5-fcd3bfe4e451 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:17.175944 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1227/2471] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:00:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:00:17.471703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:17.473201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:17.485805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1ff68-8c1b-4b9e-8ac1-1e7ba029cb9d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:17.492475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:17.493335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:17.493681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:17.494164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] PATH_INFO: `/v3/projects/4bcb0cee5e184a57883e12c34ba648f6` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:17.496210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bcb0cee5e184a57883e12c34ba648f6)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:17.499144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:17.565779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bcb0cee5e184a57883e12c34ba648f6', 'request_id': 'req-1f3fa1aa-ee53-4102-b098-96d80507692e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:17.574925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bcb0cee5e184a57883e12c34ba648f6', 'request_id': 'req-1f3fa1aa-ee53-4102-b098-96d80507692e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:17.581568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bcb0cee5e184a57883e12c34ba648f6', 'request_id': 'req-1f3fa1aa-ee53-4102-b098-96d80507692e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:17.594017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] The token cache is being invalidate because project 4bcb0cee5e184a57883e12c34ba648f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:00:17.594017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:17.594711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1f3fa1aa-ee53-4102-b098-96d80507692e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:00:17.596547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1245/2472] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:00:17 2022] DELETE /identity/v3/projects/4bcb0cee5e184a57883e12c34ba648f6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:00:18.177137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.177688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.177688 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.179001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1228/2473] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 05:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 05:00:18.185261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e8b-6d61-4b19-8af1-80c9e3f00f3d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.185785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e8b-6d61-4b19-8af1-80c9e3f00f3d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.186067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a40e8b-6d61-4b19-8af1-80c9e3f00f3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.240785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f9a40e8b-6d61-4b19-8af1-80c9e3f00f3d None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:18.242029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f9a40e8b-6d61-4b19-8af1-80c9e3f00f3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:18.266739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:18.331812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1246/2474] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:18.343989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:18.345640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:18.402533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfea759a-815a-4534-bfa6-06a9abcad97a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:18.406176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:18.406779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.407056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.407328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.417945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:18.419363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ccdb6f-3adb-406d-9eb4-17bc6233f2f3 service glance] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:18.430061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1229/2475] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:00:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:00:18.501680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.501891 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.502181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.503525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1247/2476] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 05:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 05:00:18.508356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2ef-08a8-4fbe-9ae1-ae4fd480b1d6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.508640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2ef-08a8-4fbe-9ae1-ae4fd480b1d6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.508910 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a7e2ef-08a8-4fbe-9ae1-ae4fd480b1d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.529649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-06a7e2ef-08a8-4fbe-9ae1-ae4fd480b1d6 None None] MFA Rules not processed for user `fff72313d3f14d8abbe9db7bf6e0501b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:18.530836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-06a7e2ef-08a8-4fbe-9ae1-ae4fd480b1d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:18.579560 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1230/2477] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:18.592828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:18.594635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:18.607662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4d60cd-fd54-4023-8ed2-ee74217c45e5 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:18.611159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:18.611776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.612056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.612326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.619347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:18.620817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af47bbe-8fb5-4001-ad58-1cff1ae3a0b2 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:18.628515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1248/2478] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:00:18 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:00:18.719236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b0de-fb51-44d1-ab30-f1dbeac08cc6 None None] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.719621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b0de-fb51-44d1-ab30-f1dbeac08cc6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.720092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b3b0de-fb51-44d1-ab30-f1dbeac08cc6 None None] PATH_INFO: `/` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.721260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1231/2479] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 05:00:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 20 05:00:18.726358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509e36-c79c-4912-acfc-cdac47e383da None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.726763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509e36-c79c-4912-acfc-cdac47e383da None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.727044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c509e36-c79c-4912-acfc-cdac47e383da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.746608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4c509e36-c79c-4912-acfc-cdac47e383da None None] MFA Rules not processed for user `697f2e9daa334a068f10a5ba0671aed6`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:18.747863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4c509e36-c79c-4912-acfc-cdac47e383da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:18.758368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1249/2480] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 05:00:18 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:18.769350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b0de-fb51-44d1-ab30-f1dbeac08cc6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:18.780896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b3b0de-fb51-44d1-ab30-f1dbeac08cc6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:18.784429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:18.785016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:18.785287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:18.785553 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:18.795289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:18.796720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:18.807088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1232/2481] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:00:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:00:20.631710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1274b8-5a1b-4035-ae18-b09499286c43 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:20.632492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1274b8-5a1b-4035-ae18-b09499286c43 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:20.632592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1274b8-5a1b-4035-ae18-b09499286c43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:20.653141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1d1274b8-5a1b-4035-ae18-b09499286c43 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:20.654386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d1274b8-5a1b-4035-ae18-b09499286c43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:20.712363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1250/2482] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:00:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:20.724163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:20.725546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:20.793400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb81776-0737-4233-bec9-f0c5547fae1f service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:20.798339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:20.798935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:20.799212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:20.799482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:20.804285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:20.809060 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:20.810635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:20.818604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1233/2483] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:00:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:00:30.705682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=59 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:30.815708 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:42.622345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:42.622886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:42.622886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:42.642328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:00:42.643519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:00:42.650619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1251/2484] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 05:00:42 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:00:42.663195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:00:42.673862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ac5bf7-aa3a-49f3-82f1-5a51059b5e7b service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:00:42.678773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:00:42.679354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:00:42.679629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:00:42.679935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:00:42.687954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:00:42.689520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:00:42.697715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1234/2485] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:00:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:00:52.637335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:00:52.694307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:11.527713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:11.529756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:11.629685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e259952-d3cd-4814-b961-9f50d38b75b3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:11.635022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:11.635639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:11.636420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:11.636420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:11.637942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:11.651900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:11.653489 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efa5675-d9e9-412a-a0e0-96417112402d service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:11.664005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1252/2486] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:11 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:18.314935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:18.316380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:18.350085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc61e6fb-ca76-4b85-a319-e956302d71a1 service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:18.353642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:18.354237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:18.354516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:18.354785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:18.356511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:18.416611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:18.418028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f688ad3-3203-4f02-9ab1-19463b492bcd service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:18.428093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1235/2487] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:21.536241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:21.536784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:21.536784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] PATH_INFO: `/` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:21.538179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1253/2488] 10.222.0.42 () {54 vars in 921 bytes} [Tue Sep 20 05:01:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 20 05:01:21.573178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:21.573828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:21.573952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:21.606021 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:21.607812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:21.617146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] MFA Rules not processed for user `b4740fea42bb4ac3878d893eeea5900b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:21.618509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:21.626751 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f7dc5a-1d10-47f1-9c16-234629588267 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:21.628339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1236/2489] 10.222.0.42 () {58 vars in 1018 bytes} [Tue Sep 20 05:01:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:21.631861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:21.632542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:21.632820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:21.633089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] PATH_INFO: `/v3/users/c32d9ea3c6a44d15b2b050e99524b56e` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:21.634682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c32d9ea3c6a44d15b2b050e99524b56e)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:21.636248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:21.639513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:21.650767 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d3e85d-d030-4d15-b8f6-469970b0279b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:21.657263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:21.657957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:21.658305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:21.658640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:21.668796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:21.670734 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:21.682667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1237/2490] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:01:21.691271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c32d9ea3c6a44d15b2b050e99524b56e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:21.692302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c32d9ea3c6a44d15b2b050e99524b56e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:21.693165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c32d9ea3c6a44d15b2b050e99524b56e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:21.701155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c32d9ea3c6a44d15b2b050e99524b56e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:21.714529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-019309f9-d849-4080-8f82-5f712b32e311 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c32d9ea3c6a44d15b2b050e99524b56e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:21.729617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1254/2491] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:21 2022] DELETE /identity/v3/users/c32d9ea3c6a44d15b2b050e99524b56e => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:21.896166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:21.911295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a388296-d063-4133-a2c0-76d67a22e049 service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:21.967979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:21.968627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:21.968904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:21.969746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] PATH_INFO: `/v3/projects/067a6f7df14d48b99908387a5768bca6` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:21.970873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] RBAC: Authorizing `identity:delete_project(project_id=067a6f7df14d48b99908387a5768bca6)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:21.972790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.013897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:22.018409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '067a6f7df14d48b99908387a5768bca6', 'request_id': 'req-37fc429e-8e7b-4349-b4c1-21decb85f53b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:22.024989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '067a6f7df14d48b99908387a5768bca6', 'request_id': 'req-37fc429e-8e7b-4349-b4c1-21decb85f53b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:22.030614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '067a6f7df14d48b99908387a5768bca6', 'request_id': 'req-37fc429e-8e7b-4349-b4c1-21decb85f53b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:22.042892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] The token cache is being invalidate because project 067a6f7df14d48b99908387a5768bca6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:22.043183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:22.043845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-37fc429e-8e7b-4349-b4c1-21decb85f53b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:22.045296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1238/2492] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:21 2022] DELETE /identity/v3/projects/067a6f7df14d48b99908387a5768bca6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:22.050249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.050528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.050798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.089029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:22.090465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:22.114378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:22.160770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1255/2493] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:22.168542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.168831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.169105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.188526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:22.189731 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:22.197571 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1239/2494] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:22.201807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.212810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb34e8cd-b45d-4878-8f8c-15dd6f7afb16 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.218274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.218886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.219770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.220071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.220727 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:22.221031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.222660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.234179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1256/2495] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:01:22.238429 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.247690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d86cb4-a5df-4763-8c2e-b5fd8c0ba3ff None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.252323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.252940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.253213 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.253567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.254244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.256430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.284383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1240/2496] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:22 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:22.288326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.298139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a01e17-abec-4c43-931e-94cb62402e59 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.352811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.353455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.353735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.354003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.354629 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.356676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.377298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1257/2497] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:22 2022] POST /identity/v3/users => generated 284 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:22.381664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.392439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89dd9524-6e4e-43a9-aafb-3c5cf57e747d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.397131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.397722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.397994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.398259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.398888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.400512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.410408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1241/2498] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:22.414140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.423912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5829eefc-3079-496d-a25b-e62ce05f9c69 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.428428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.429019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.429301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.429564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.430200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.431817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e9bcb5-cd56-4da3-b5ba-123b6cc602d1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.442899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1258/2499] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:22 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:22.447192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.457698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f007896-60a1-428a-949d-1e563d918850 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.462248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.462883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.463160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.463432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] PATH_INFO: `/v3/projects/90b87efe0fb748739bfed8a990abeae0/users/a73aeb6b6c5c4e5481dab1b29a24829f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.477602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b87efe0fb748739bfed8a990abeae0, user_id=a73aeb6b6c5c4e5481dab1b29a24829f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.480262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.492913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1242/2500] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:22 2022] PUT /identity/v3/projects/90b87efe0fb748739bfed8a990abeae0/users/a73aeb6b6c5c4e5481dab1b29a24829f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:22.503547 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.503877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.504148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.531664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] MFA Rules not processed for user `a73aeb6b6c5c4e5481dab1b29a24829f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:22.532933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:22.595166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1259/2501] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:22.605848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:22.607505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:22.685481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bd2c5e-7fee-4131-9607-b849a1bf01ec admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:22.689672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:22.690269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:22.690547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:22.690821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:22.699131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:22.700602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-936f1ed2-7dac-4799-9a33-e6cff90f4c02 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:22.709898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1243/2502] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:22 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:32.111314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:32.135700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:32.173647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e2b2d4-2c3f-49c0-b765-84bd30f438a1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:32.178124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:32.178753 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.179026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.179293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] PATH_INFO: `/v3/users/a73aeb6b6c5c4e5481dab1b29a24829f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.180425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a73aeb6b6c5c4e5481dab1b29a24829f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:32.182336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:32.228887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a73aeb6b6c5c4e5481dab1b29a24829f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.229539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a73aeb6b6c5c4e5481dab1b29a24829f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.230138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a73aeb6b6c5c4e5481dab1b29a24829f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.237453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a73aeb6b6c5c4e5481dab1b29a24829f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.249070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a73aeb6b6c5c4e5481dab1b29a24829f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.261998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1260/2503] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:32 2022] DELETE /identity/v3/users/a73aeb6b6c5c4e5481dab1b29a24829f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:32.266530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.267036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.267140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.286537 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:32.287858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:32.334905 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:32.350959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1244/2504] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:32.361288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:32.362695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:32.418292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7be300-eeee-4299-87ba-32118dbf13e7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:32.422117 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:32.423370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.423648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.423952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.438890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:32.440841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-347d1795-2b16-4474-8288-8b81e8acb91b service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:32.452052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1261/2505] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:32.727635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:32.729129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:32.741613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4db9e-61c0-4585-8772-7410fd876177 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:32.747155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:32.747845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.748199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.748381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] PATH_INFO: `/v3/projects/90b87efe0fb748739bfed8a990abeae0` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.749573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b87efe0fb748739bfed8a990abeae0)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:32.751442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:32.798988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b87efe0fb748739bfed8a990abeae0', 'request_id': 'req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.805281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b87efe0fb748739bfed8a990abeae0', 'request_id': 'req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.810766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b87efe0fb748739bfed8a990abeae0', 'request_id': 'req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.823711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] The token cache is being invalidate because project 90b87efe0fb748739bfed8a990abeae0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:32.824043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.824656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-94314cb6-f4ae-4bd7-9bd8-a42f18cfadf4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:32.826103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1245/2506] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:32 2022] DELETE /identity/v3/projects/90b87efe0fb748739bfed8a990abeae0 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:32.831627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.831939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.832211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.851694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:32.852907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:32.892282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:32.912516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1262/2507] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:32.921393 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.921678 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.921950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.942621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:32.943842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:32.951417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1246/2508] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:32.956192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:32.965962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec1fceb-f9c4-4a9b-aee0-739faf1d8929 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:32.970680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:32.971274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:32.971553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:32.971861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:32.972499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:32.972800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:32.974418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:32.985655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1263/2509] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:01:32.989850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:32.998847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b312c6-230d-4db6-acd6-e77d379cf93c None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.004394 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.004992 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.005269 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.005540 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.006445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.008384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.034449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1247/2510] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:32 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:33.038482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.048282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f4167e-42a1-4b2a-8ec3-5d11ffa9ec27 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.103416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.104063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.104360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.104635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.105256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.107177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.128780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1264/2511] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:33 2022] POST /identity/v3/users => generated 291 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:33.133091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.143706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86da11f-2d2a-49c1-b804-2050985329ed admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.148210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.148799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.149074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.149340 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.149968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.151559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.161758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1248/2512] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:33.165519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.175217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f91b18-01fe-499a-948b-c45aa1777ead admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.179764 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.180348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.180628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.180901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.181538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.183133 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89db1da6-5d3e-4ee5-8e73-90763ab15c4d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.194116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1265/2513] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:33.197866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.208780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696a671f-e9a8-4737-b84b-a10043fdb296 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.213946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.214559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.214840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.215114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] PATH_INFO: `/v3/projects/b7055db2fbdb43829bf8bd1a699a3d62/users/62120daec5f546c484daa460f8d69cd1/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.229594 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7055db2fbdb43829bf8bd1a699a3d62, user_id=62120daec5f546c484daa460f8d69cd1, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.232286 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.245573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1249/2514] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:33 2022] PUT /identity/v3/projects/b7055db2fbdb43829bf8bd1a699a3d62/users/62120daec5f546c484daa460f8d69cd1/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:33.256775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.257059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.257374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.284378 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] MFA Rules not processed for user `62120daec5f546c484daa460f8d69cd1`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:33.285593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:33.349438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1266/2515] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:33.354203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.418618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef4ce63-5993-4fab-96d8-dbe76ddfcf1f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.424296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.424997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.425342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.425794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.426668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.429026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.448472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:33.461539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1250/2516] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:33 2022] POST /identity/v3/projects => generated 381 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:33.465171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.475613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08beba6-b4d0-4aff-b02a-ec0307973965 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.515508 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:33.538383 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.539001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.539280 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.539554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.540217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.542134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.564945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1267/2517] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:33 2022] POST /identity/v3/users => generated 297 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:33.568913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.579614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f50e57f-36dd-4c65-ba79-cf7902988d4c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.584388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.585091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.585444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.585805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.586449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.588088 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.599443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1251/2518] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:33.603855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.614870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b66db67-3d51-470d-a73f-585a2d2e4c12 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.619658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.620338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.620617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.620889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] PATH_INFO: `/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15/users/531280c7e6104e8f82e5f40ca2ed1e62/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.636810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f79f7a6fe884f179fd05c49a3e04a15, user_id=531280c7e6104e8f82e5f40ca2ed1e62, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.639597 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.653837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1268/2519] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:33 2022] PUT /identity/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15/users/531280c7e6104e8f82e5f40ca2ed1e62/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:33.658240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.668810 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d441ddaf-da22-48f7-8fe5-d677c095602b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.727192 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.727827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.728102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.728373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.729004 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.730619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e51f4b70-2b7c-4f37-a4fb-9156aef09cfb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.741665 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1252/2520] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:33 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:01:33.746255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.757585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d465b1-4454-4f5b-b57c-7f926442d5e4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.763232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.764104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.764386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.764654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] PATH_INFO: `/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15/users/531280c7e6104e8f82e5f40ca2ed1e62/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.766585 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f79f7a6fe884f179fd05c49a3e04a15, user_id=531280c7e6104e8f82e5f40ca2ed1e62, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.769457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.781539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1269/2521] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:33 2022] PUT /identity/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15/users/531280c7e6104e8f82e5f40ca2ed1e62/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:33.792973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.793256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.793531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.824074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] MFA Rules not processed for user `531280c7e6104e8f82e5f40ca2ed1e62`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:33.825356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:33.897117 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1253/2522] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:33 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:33.909437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:33.911165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:33.968067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-771b0409-b17c-4866-b671-18d62501a6d7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:33.972449 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:33.973048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:33.973325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:33.973595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:33.982553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:33.984003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:33.993561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1270/2523] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:33 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:34.067590 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:34.077155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bff8e69-32bf-4d53-9f47-b5cdac243dde None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:34.081263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:34.081855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:34.082132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:34.082402 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:34.138351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:34.139696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74e339d0-f025-40dd-ae96-6016d24a4da5 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:34.148952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1254/2524] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:40.919657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:40.983198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b4f524-04ec-4c16-9c1d-b65d0d3a71d2 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:40.987712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:40.989008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:40.989282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:40.989548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] PATH_INFO: `/v3/users/62120daec5f546c484daa460f8d69cd1` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:40.990692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62120daec5f546c484daa460f8d69cd1)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:40.992662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:41.030559 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:41.041312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62120daec5f546c484daa460f8d69cd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.041961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62120daec5f546c484daa460f8d69cd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.042568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62120daec5f546c484daa460f8d69cd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.049894 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62120daec5f546c484daa460f8d69cd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.063332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62120daec5f546c484daa460f8d69cd1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.078143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1271/2525] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:40 2022] DELETE /identity/v3/users/62120daec5f546c484daa460f8d69cd1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:41.083631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:41.085357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:41.085698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:41.096950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:41.109242 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:41.110739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:41.173569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1255/2526] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:41.183793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:41.185230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:41.242694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418650fe-e7a4-45a7-945a-f869f93ada52 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:41.246348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:41.247009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:41.247230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:41.247500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:41.256552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:41.257976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:41.267194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1272/2527] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:41.565516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:41.568927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:41.582591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-537b8c0e-a358-4562-8eea-e47941e0bd65 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:41.588777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:41.589475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:41.589760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:41.590036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] PATH_INFO: `/v3/projects/b7055db2fbdb43829bf8bd1a699a3d62` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:41.591169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7055db2fbdb43829bf8bd1a699a3d62)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:41.593098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:41.642738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7055db2fbdb43829bf8bd1a699a3d62', 'request_id': 'req-439bec4b-f416-48e3-b0d7-1323b68f6f5c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.649107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7055db2fbdb43829bf8bd1a699a3d62', 'request_id': 'req-439bec4b-f416-48e3-b0d7-1323b68f6f5c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.654878 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7055db2fbdb43829bf8bd1a699a3d62', 'request_id': 'req-439bec4b-f416-48e3-b0d7-1323b68f6f5c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.668601 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] The token cache is being invalidate because project b7055db2fbdb43829bf8bd1a699a3d62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:41.668893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.669516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.670985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1256/2528] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:41 2022] DELETE /identity/v3/projects/b7055db2fbdb43829bf8bd1a699a3d62 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:41.674961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:41.685195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0841f1e7-207d-4c0a-84c3-58ff775d9a0a service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:41.743203 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:41.743853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:41.744129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:41.744396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] PATH_INFO: `/v3/users/531280c7e6104e8f82e5f40ca2ed1e62` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:41.745504 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=531280c7e6104e8f82e5f40ca2ed1e62)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:41.747402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:41.796100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '531280c7e6104e8f82e5f40ca2ed1e62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.796855 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '531280c7e6104e8f82e5f40ca2ed1e62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.797738 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '531280c7e6104e8f82e5f40ca2ed1e62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.806386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '531280c7e6104e8f82e5f40ca2ed1e62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.808916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:41.824025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d2155510-1333-498a-b03e-2f87f3758ef7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '531280c7e6104e8f82e5f40ca2ed1e62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:41.839363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1273/2529] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:41 2022] DELETE /identity/v3/users/531280c7e6104e8f82e5f40ca2ed1e62 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:42.110682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.112246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:42.125197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439bec4b-f416-48e3-b0d7-1323b68f6f5c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.182705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.183335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.183614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.183920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] PATH_INFO: `/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.185135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f79f7a6fe884f179fd05c49a3e04a15)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.187131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.222363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:42.236772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f79f7a6fe884f179fd05c49a3e04a15', 'request_id': 'req-90b72435-b87f-4c15-9e40-c700844c304e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:42.242749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f79f7a6fe884f179fd05c49a3e04a15', 'request_id': 'req-90b72435-b87f-4c15-9e40-c700844c304e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:42.248350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f79f7a6fe884f179fd05c49a3e04a15', 'request_id': 'req-90b72435-b87f-4c15-9e40-c700844c304e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:42.260880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] The token cache is being invalidate because project 4f79f7a6fe884f179fd05c49a3e04a15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:42.261178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:42.261796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-90b72435-b87f-4c15-9e40-c700844c304e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:42.263255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1257/2530] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:42 2022] DELETE /identity/v3/projects/4f79f7a6fe884f179fd05c49a3e04a15 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:42.268131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.268633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.268758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.288478 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:42.289675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:42.346510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1274/2531] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:42.353981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.354268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.354543 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.374025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:42.375232 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:42.383862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1258/2532] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:42.388067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.398143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552f287b-034a-4b45-80e9-93f50073bf63 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.402689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.403286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.403564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.403870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.404511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:42.404810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.406393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.418220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1275/2533] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:01:42.422441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.432214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fcba65-1f7b-47b9-abba-9932577a1824 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.437094 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.437718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.437998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.438386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.439043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.440976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.467585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1259/2534] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:42.471746 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.482172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe96a539-5563-445b-99de-b78a2650a520 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.538255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.538847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.539123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.539392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.540054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.541953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.562841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1276/2535] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/users => generated 284 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:42.566999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.577223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fea1861-e64d-45c0-99ab-c68ad8c1ab04 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.581858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.583120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.583400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.583672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.584345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.585942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.595656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1260/2536] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:42.600010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.610399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae9eb69-d0a6-42ad-9180-fb6efaed5605 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.614970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.615552 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.615854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.616122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.616748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.618324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fe10c1-1ce8-4d04-b41b-3de047073767 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.628575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1277/2537] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:01:42.632851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.642756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000d4215-74a3-49b6-bccd-6c71bb6b6a3a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.647965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.648608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.648886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.649158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] PATH_INFO: `/v3/projects/8224b6a0ac7a4f05998cacd213400c25/users/5410f171e6d94f4e93c779cc71efd49c/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.664331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] RBAC: Authorizing `identity:create_grant(project_id=8224b6a0ac7a4f05998cacd213400c25, user_id=5410f171e6d94f4e93c779cc71efd49c, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.666970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.679857 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1261/2538] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:42 2022] PUT /identity/v3/projects/8224b6a0ac7a4f05998cacd213400c25/users/5410f171e6d94f4e93c779cc71efd49c/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:42.690022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef047-b168-409c-a464-74d0123cc37f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.690304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef047-b168-409c-a464-74d0123cc37f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.690575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caef047-b168-409c-a464-74d0123cc37f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.718167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7caef047-b168-409c-a464-74d0123cc37f None None] MFA Rules not processed for user `5410f171e6d94f4e93c779cc71efd49c`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:42.719369 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7caef047-b168-409c-a464-74d0123cc37f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:42.750200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:42.786172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1278/2539] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:42.790651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.851367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468ce1fe-27e7-46da-9223-09091fd243af admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.855958 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.856551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.856829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.857096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.857720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.859607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.886873 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1262/2540] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/projects => generated 367 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:42.890886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caef047-b168-409c-a464-74d0123cc37f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.901566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caef047-b168-409c-a464-74d0123cc37f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:42.956934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:42.957579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:42.957852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:42.958118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:42.958749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:42.960690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:42.981591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1279/2541] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:42 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:42.985866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:42.997045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2554e730-9f7a-4ec3-a1a5-2b70dccf1c28 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:43.001999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:43.002595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.002882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.003150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.004350 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:43.006203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:43.016839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1263/2542] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:43.021869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:43.032013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f941583d-80bd-4650-80f5-3bbc04d44d7e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:43.036705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:43.037426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.037768 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.038103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] PATH_INFO: `/v3/projects/d2de57d86a4340f98650c18102518709/users/ee3b02a0584941a8ac5c4070082323ed/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.054140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de57d86a4340f98650c18102518709, user_id=ee3b02a0584941a8ac5c4070082323ed, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:43.056982 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:43.070187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1280/2543] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:43 2022] PUT /identity/v3/projects/d2de57d86a4340f98650c18102518709/users/ee3b02a0584941a8ac5c4070082323ed/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:43.074309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:43.085362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d881ba-825e-4b4d-a0c9-f13074b46d11 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:43.111510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:43.145109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:43.145723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.145997 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.146264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.146935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:43.148539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b073a18-935c-41d7-946c-8c1bf5b5d000 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:43.160874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1264/2544] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:43 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:43.164897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:43.175244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c26ec5-a3d8-4cb3-b676-4e893e3cca4b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:43.179989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:43.180630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.180904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.181171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] PATH_INFO: `/v3/projects/d2de57d86a4340f98650c18102518709/users/ee3b02a0584941a8ac5c4070082323ed/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.183046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2de57d86a4340f98650c18102518709, user_id=ee3b02a0584941a8ac5c4070082323ed, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:43.185685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:43.196336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1281/2545] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:43 2022] PUT /identity/v3/projects/d2de57d86a4340f98650c18102518709/users/ee3b02a0584941a8ac5c4070082323ed/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:43.207756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.208061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.208356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.237612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] MFA Rules not processed for user `ee3b02a0584941a8ac5c4070082323ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:43.239474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:43.305981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1265/2546] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:43 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:43.317022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:43.318728 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:43.377786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82383d2e-c100-4e82-a112-b57542ab23e4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:43.382204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:43.382799 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:43.383097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:43.383362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:43.391981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:43.393422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-352fdf9f-afa5-4d3e-8434-452d4bd6d07d service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:43.403588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1282/2547] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:44.758747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:44.822068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c3a988-836c-423a-a7f7-6f23b051a44b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:44.827150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:44.827150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:44.827557 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:44.827652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] PATH_INFO: `/v3/users/5410f171e6d94f4e93c779cc71efd49c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:44.828850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5410f171e6d94f4e93c779cc71efd49c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:44.830833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:44.889304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5410f171e6d94f4e93c779cc71efd49c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:44.889960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5410f171e6d94f4e93c779cc71efd49c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:44.890563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5410f171e6d94f4e93c779cc71efd49c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:44.895634 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:44.905256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5410f171e6d94f4e93c779cc71efd49c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:44.913169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5410f171e6d94f4e93c779cc71efd49c'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:44.926701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1266/2548] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:44 2022] DELETE /identity/v3/users/5410f171e6d94f4e93c779cc71efd49c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:44.931198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:44.931670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:44.931670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:44.951224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:44.952458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:44.977818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:45.020986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1283/2549] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:45.030912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:45.032447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:45.102709 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03d3317b-85cb-4b6b-a921-2389cfff9040 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:45.106869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:45.107657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:45.108123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:45.108566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:45.119920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:45.121476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:45.132666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1267/2550] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:45.510915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:45.513254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:45.532492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e35ef6-11d9-44dd-9fde-99947a45e15b None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:45.538121 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:45.538852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:45.539061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:45.539347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] PATH_INFO: `/v3/projects/8224b6a0ac7a4f05998cacd213400c25` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:45.540592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8224b6a0ac7a4f05998cacd213400c25)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:45.542498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:45.590031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8224b6a0ac7a4f05998cacd213400c25', 'request_id': 'req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.599474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8224b6a0ac7a4f05998cacd213400c25', 'request_id': 'req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.606058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8224b6a0ac7a4f05998cacd213400c25', 'request_id': 'req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.617727 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] The token cache is being invalidate because project 8224b6a0ac7a4f05998cacd213400c25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:45.618013 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.618678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.620212 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1284/2551] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:45 2022] DELETE /identity/v3/projects/8224b6a0ac7a4f05998cacd213400c25 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:45.624160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:45.634659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337be30-c01c-4686-8bc2-1a1a4bceb31f service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:45.702565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:45.703275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:45.703625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:45.703991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] PATH_INFO: `/v3/users/ee3b02a0584941a8ac5c4070082323ed` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:45.705320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee3b02a0584941a8ac5c4070082323ed)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:45.708191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:45.756904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee3b02a0584941a8ac5c4070082323ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.758265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee3b02a0584941a8ac5c4070082323ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.758907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee3b02a0584941a8ac5c4070082323ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.775407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee3b02a0584941a8ac5c4070082323ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.782803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fb7a217c-b160-47c6-9868-2083f7a80aea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee3b02a0584941a8ac5c4070082323ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:45.784663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:45.806797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1268/2552] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:45 2022] DELETE /identity/v3/users/ee3b02a0584941a8ac5c4070082323ed => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:46.115353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.116958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:46.136962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912a0066-0bc1-4aeb-b5c1-f1175fbf0986 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.197561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.198266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.198583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.198852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] PATH_INFO: `/v3/projects/d2de57d86a4340f98650c18102518709` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.200045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2de57d86a4340f98650c18102518709)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.201975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.250211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2de57d86a4340f98650c18102518709', 'request_id': 'req-d788fc9f-f6aa-439b-835e-82482f6f4c1b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:46.252619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:46.259713 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2de57d86a4340f98650c18102518709', 'request_id': 'req-d788fc9f-f6aa-439b-835e-82482f6f4c1b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:46.267444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2de57d86a4340f98650c18102518709', 'request_id': 'req-d788fc9f-f6aa-439b-835e-82482f6f4c1b'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:46.278247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] The token cache is being invalidate because project d2de57d86a4340f98650c18102518709 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:46.278532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:46.279198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d788fc9f-f6aa-439b-835e-82482f6f4c1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:46.280749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1285/2553] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:46 2022] DELETE /identity/v3/projects/d2de57d86a4340f98650c18102518709 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:46.285595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.285876 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.286169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.307121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:46.308448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:46.373755 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1269/2554] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:46.382346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.382637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.382913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.402795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:46.404032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:46.412607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1286/2555] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:46.416890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.426774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b16af-f539-4483-b06e-1ba94633d33a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.431524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.432331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.432619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.433085 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.434260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:46.434575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.436302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.450725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1270/2556] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 05:01:46.455742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.466371 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba75e53b-05f2-494a-a90b-accdea2a1da9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.470984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.471574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.471888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.472160 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.473421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.475318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.502499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1287/2557] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/projects => generated 379 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:46.507315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.517582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc18974b-3bc7-4ac6-a0fd-73eba8cf02d7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.579216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.579862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.580149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.580427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.581073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.583551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.609326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1271/2558] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/users => generated 290 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:46.610631 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.621587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecaa5198-6b65-459b-be61-f6ef991b386d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.626174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.626766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.627044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.627315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.627989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.630136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.640776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1288/2559] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:46.644725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.654727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c156d909-9566-4414-9f65-6f9802efae7a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.659488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.660650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.660928 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.661200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.661837 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.663426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e550e5db-ea50-4dd8-b79f-78f1d0028413 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.674354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1272/2560] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:46.679017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.689524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a5598-493b-4ab7-bbfc-2fdb980b9af4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.694588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.695246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.695524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.695929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] PATH_INFO: `/v3/projects/c8fce8c4640b4ec1a4a491915f92b4b9/users/34ef4867584e462d86a4ff022c4b7915/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.712676 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c8fce8c4640b4ec1a4a491915f92b4b9, user_id=34ef4867584e462d86a4ff022c4b7915, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.715560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.731630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1289/2561] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:46 2022] PUT /identity/v3/projects/c8fce8c4640b4ec1a4a491915f92b4b9/users/34ef4867584e462d86a4ff022c4b7915/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:46.742500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.742783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.743055 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.771687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] MFA Rules not processed for user `34ef4867584e462d86a4ff022c4b7915`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:46.772860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:46.817957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:46.841216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1273/2562] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:46.845737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.908294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fbdb18-6070-42c0-9a49-7b25c701f6d2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:46.913558 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:46.914158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:46.914431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:46.914705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:46.915324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:46.917255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:46.944897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1290/2563] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:46.948962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:46.959600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867bac1d-0ec8-4548-aa38-04629c67feb2 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.018389 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.019002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.019976 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.020363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.021009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.022978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.044804 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1274/2564] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:46 2022] POST /identity/v3/users => generated 295 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:47.048889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:47.060777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a0b425-aac6-4743-8544-a45365a7c28b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.065653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.066363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.066642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.066910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.067574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.069199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.081347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1291/2565] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:01:47.087337 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:47.098425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b495a5-edae-4752-ac04-a77ee2ce66c3 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.103134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.103832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.104105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.104374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] PATH_INFO: `/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54/users/cbe80b925e08482f89054a569b6048a8/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.120276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2e4cd6aafb4ba59aaec4b0baec2b54, user_id=cbe80b925e08482f89054a569b6048a8, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.122901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.137071 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1275/2566] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:47 2022] PUT /identity/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54/users/cbe80b925e08482f89054a569b6048a8/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:47.141016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:47.151839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45be8d9b-1c51-4460-970f-77db71c61059 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.201026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=3,keystone:SELECT=94,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:47.212490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.213139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.213662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.213974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.214573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.216284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-774dac1b-dd66-4bf8-b820-eec83e0ecf9f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.227660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1292/2567] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:47 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:47.231984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:47.243043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd9dda-5445-4dd8-a9d0-5b6ac4681fca admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.248851 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.249505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.249778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.250047 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] PATH_INFO: `/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54/users/cbe80b925e08482f89054a569b6048a8/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.252097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a2e4cd6aafb4ba59aaec4b0baec2b54, user_id=cbe80b925e08482f89054a569b6048a8, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.255906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.267190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1276/2568] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:47 2022] PUT /identity/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54/users/cbe80b925e08482f89054a569b6048a8/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:47.279009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.279334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.279561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.307106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] MFA Rules not processed for user `cbe80b925e08482f89054a569b6048a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:47.308329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:47.376591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1293/2569] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:47 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:47.389930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:47.392311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:47.456541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2248c2de-2c24-4946-a46e-4c0ddf9ca7fc admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:47.462171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:47.462864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:47.463224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:47.463502 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:47.521966 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:47.526659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:47.528251 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:47.537378 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1277/2570] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:47 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:48.888289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:48.897989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f29717e-d243-49be-affe-3d131cb2d4be None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:48.901620 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:48.902222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:48.902500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:48.902771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:48.912223 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:48.913641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:48.922885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1294/2571] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:50.722206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:50.723717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:50.783452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e8078c-fc46-4c78-a8f7-3bca1c675654 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:50.787048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:50.787657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:50.788015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:50.788297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:50.790038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:50.856050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:50.857662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-610d9d0c-99db-4d06-bf15-6296204478ae service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:50.874512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1278/2572] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:52.759561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:52.773485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d387f6-b049-47df-9308-18095ecb9225 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:52.778511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:52.779182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:52.779667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:52.780195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] PATH_INFO: `/v3/users/34ef4867584e462d86a4ff022c4b7915` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:52.781581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] RBAC: Authorizing `identity:delete_user(user_id=34ef4867584e462d86a4ff022c4b7915)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:52.783690 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:52.839642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34ef4867584e462d86a4ff022c4b7915'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:52.840365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34ef4867584e462d86a4ff022c4b7915'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:52.840994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34ef4867584e462d86a4ff022c4b7915'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:52.848628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34ef4867584e462d86a4ff022c4b7915'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:52.861565 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34ef4867584e462d86a4ff022c4b7915'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:52.876735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1295/2573] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:52 2022] DELETE /identity/v3/users/34ef4867584e462d86a4ff022c4b7915 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:52.883626 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:52.884196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:52.884196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:52.908282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:52.909542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:52.985194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1279/2574] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:52.996247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:52.997787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:53.036484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:53.065540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc9fed8-078e-4d21-a45d-0de04d352afb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:53.074776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:53.076509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:53.077305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:53.078376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:53.115470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:53.117230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:53.136364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1296/2575] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:53.463197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:53.465416 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:53.483985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447d12b2-c607-4cf4-9f6a-bf1db4e95819 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:53.496176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:53.496176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:53.496176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:53.496176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] PATH_INFO: `/v3/projects/c8fce8c4640b4ec1a4a491915f92b4b9` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:53.497684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c8fce8c4640b4ec1a4a491915f92b4b9)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:53.500169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:53.548462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:53.558174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c8fce8c4640b4ec1a4a491915f92b4b9', 'request_id': 'req-57fb26ee-b941-49cb-8c24-d672d48dbec8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.564487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c8fce8c4640b4ec1a4a491915f92b4b9', 'request_id': 'req-57fb26ee-b941-49cb-8c24-d672d48dbec8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.570135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c8fce8c4640b4ec1a4a491915f92b4b9', 'request_id': 'req-57fb26ee-b941-49cb-8c24-d672d48dbec8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.585787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] The token cache is being invalidate because project c8fce8c4640b4ec1a4a491915f92b4b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:53.586102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.586727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.588254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1280/2576] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:53 2022] DELETE /identity/v3/projects/c8fce8c4640b4ec1a4a491915f92b4b9 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:53.592930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:53.603523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9c6f96-4d28-40fc-b2e4-69f93c7f6544 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:53.660900 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:53.661536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:53.661814 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:53.662085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] PATH_INFO: `/v3/users/cbe80b925e08482f89054a569b6048a8` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:53.663230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe80b925e08482f89054a569b6048a8)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:53.665307 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:53.710539 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe80b925e08482f89054a569b6048a8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.711193 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe80b925e08482f89054a569b6048a8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.711836 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe80b925e08482f89054a569b6048a8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.719616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe80b925e08482f89054a569b6048a8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.732870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-275f1eb8-21a4-4e6d-9909-d7ac71360a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe80b925e08482f89054a569b6048a8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:53.748207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1297/2577] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:53 2022] DELETE /identity/v3/users/cbe80b925e08482f89054a569b6048a8 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:54.246239 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.247897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:54.261607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fb26ee-b941-49cb-8c24-d672d48dbec8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.357592 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.358610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.358894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.359169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] PATH_INFO: `/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.360361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a2e4cd6aafb4ba59aaec4b0baec2b54)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.362334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.431971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a2e4cd6aafb4ba59aaec4b0baec2b54', 'request_id': 'req-66bab456-b846-4949-a0e9-208b57fe1a55'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:54.446658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a2e4cd6aafb4ba59aaec4b0baec2b54', 'request_id': 'req-66bab456-b846-4949-a0e9-208b57fe1a55'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:54.455181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a2e4cd6aafb4ba59aaec4b0baec2b54', 'request_id': 'req-66bab456-b846-4949-a0e9-208b57fe1a55'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:54.478314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] The token cache is being invalidate because project 5a2e4cd6aafb4ba59aaec4b0baec2b54 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:54.478599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:54.479338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-66bab456-b846-4949-a0e9-208b57fe1a55 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:54.485249 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1281/2578] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:54 2022] DELETE /identity/v3/projects/5a2e4cd6aafb4ba59aaec4b0baec2b54 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:54.486580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.487040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.487295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.528596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:54.529841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:54.597434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:54.611551 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1298/2579] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:54.620374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.620693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.621016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.645362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:54.646581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:54.654923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1282/2580] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:54.659971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.677580 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c84e8-fa5a-4411-9ec1-b8d30a350475 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.683248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.684180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.684344 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.684607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.685257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:54.685555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.687172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.705339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1299/2581] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:01:54.710022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.722247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73d8dea-fb8e-4590-a579-62bc032078ee None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.727715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.728356 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.728635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.728901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.729545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.731490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.764009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1283/2582] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:54 2022] POST /identity/v3/projects => generated 381 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:54.768747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.779482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f7729e-fc10-449f-b215-05e5f328762d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.845838 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.846480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.846755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.847089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.847922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.850079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.875286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1300/2583] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:54 2022] POST /identity/v3/users => generated 291 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:54.879777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.907551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9930a98a-5400-41ae-bae2-d0cf8a3ca84f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.913141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.914345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.914345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.914345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.915063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.916884 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.928260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1284/2584] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:54.932266 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.933501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.935296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:54.944147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1ce830-f4f2-462b-8293-a35d73c4d4c2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.948839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.949437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.950046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.950470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:54.951363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:54.953168 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:54.959120 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:54.967869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1301/2585] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:01:54.972647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:54.985525 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a69109e-9403-4be1-a340-03b1f1a09df7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:54.992477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:54.993139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:54.993408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:54.993870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] PATH_INFO: `/v3/projects/f29dbca1324a43e4af814c861611b1ef/users/7362f2682f174127ac98e158e97b3944/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.018670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f29dbca1324a43e4af814c861611b1ef, user_id=7362f2682f174127ac98e158e97b3944, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.021388 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.029463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4583870-e053-4dd8-9d4c-827ec9c99bde admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.034022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1302/2586] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:54 2022] PUT /identity/v3/projects/f29dbca1324a43e4af814c861611b1ef/users/7362f2682f174127ac98e158e97b3944/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:55.035373 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.037140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.097507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.098063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.098335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.098604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.100903 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.107556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2223983-0ef1-487d-af95-17fc6151737c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.112019 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.113172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.113804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.114082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.114214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a3b0e2-8245-4586-be74-cdac035d911f service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.114379 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] PATH_INFO: `/v3/users/b94077b7a43c42b68f633afe3c9ce715` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.115581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94077b7a43c42b68f633afe3c9ce715)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.117563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.125305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1285/2587] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:54 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:55.128477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.128763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.129073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.163527 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:INSERT=4,keystone:DELETE=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:55.166262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] MFA Rules not processed for user `7362f2682f174127ac98e158e97b3944`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:55.167608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.173685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94077b7a43c42b68f633afe3c9ce715'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.174675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94077b7a43c42b68f633afe3c9ce715'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.176069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94077b7a43c42b68f633afe3c9ce715'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.183627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94077b7a43c42b68f633afe3c9ce715'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.196604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94077b7a43c42b68f633afe3c9ce715'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.209538 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1303/2588] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:55 2022] DELETE /identity/v3/users/b94077b7a43c42b68f633afe3c9ce715 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:55.234570 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1286/2589] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:55.239722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.241172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.308688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c9f4ac-2ea9-4463-a34e-ac35ed65677b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.313260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.313863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.314136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.314402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.315026 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.316979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.344803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1304/2590] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/projects => generated 379 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:55.349173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.359904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089c68b8-a328-4b5a-a5c3-4e0ce363d60d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.386598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.388805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.417695 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:55.449518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.450282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.450559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.450829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.451608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.453544 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.462829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc44a7eb-733f-4b75-9b12-02b8a8c28445 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.469346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.470219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.470606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.471174 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] PATH_INFO: `/v3/projects/cefe4027041d4b7ea9939c687c2b372a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.472202 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cefe4027041d4b7ea9939c687c2b372a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.474144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.476084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1287/2591] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/users => generated 296 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:55.480197 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.490666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83b502d-b13e-4627-9090-1f135472059c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.497617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.498224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.498500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.498770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.499406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.501105 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.517401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1288/2592] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:55.518714 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.522339 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=8,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:55.529970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec9bfc7-707d-4064-bfba-e0181321beac admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.530808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cefe4027041d4b7ea9939c687c2b372a', 'request_id': 'req-4983ab8e-639d-45c8-84ef-567fcff9cf62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.539990 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cefe4027041d4b7ea9939c687c2b372a', 'request_id': 'req-4983ab8e-639d-45c8-84ef-567fcff9cf62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.547897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cefe4027041d4b7ea9939c687c2b372a', 'request_id': 'req-4983ab8e-639d-45c8-84ef-567fcff9cf62'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.562926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] The token cache is being invalidate because project cefe4027041d4b7ea9939c687c2b372a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:55.563246 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.563984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-4983ab8e-639d-45c8-84ef-567fcff9cf62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:55.566351 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1305/2593] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:55 2022] DELETE /identity/v3/projects/cefe4027041d4b7ea9939c687c2b372a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:55.574220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b18-2076-4701-91bd-2297444f9836 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.574570 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b18-2076-4701-91bd-2297444f9836 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.574906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76805b18-2076-4701-91bd-2297444f9836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.596541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-76805b18-2076-4701-91bd-2297444f9836 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:55.598059 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-76805b18-2076-4701-91bd-2297444f9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.613161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.614005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.614281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.614552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] PATH_INFO: `/v3/projects/96598498621d465ea2656ccb2f62e9d6/users/84549c4e698e4188912ab1231065a071/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.631431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96598498621d465ea2656ccb2f62e9d6, user_id=84549c4e698e4188912ab1231065a071, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.634106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.648303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1289/2594] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:55 2022] PUT /identity/v3/projects/96598498621d465ea2656ccb2f62e9d6/users/84549c4e698e4188912ab1231065a071/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:55.652615 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.654663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.671708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1306/2595] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:55.672584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76805b18-2076-4701-91bd-2297444f9836 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.674033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-76805b18-2076-4701-91bd-2297444f9836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.687765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76805b18-2076-4701-91bd-2297444f9836 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.721354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c0bfc7-75b5-45c1-af8b-141d910496c0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.726396 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.727187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.727541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.727960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.729933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.749862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.750485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.750767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.751050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.751688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.753458 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1b3841d-f855-4b9d-bb9c-2a67f8b40c32 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.763815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1307/2596] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:55 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:55.765064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.765668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.766130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.792772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:55.794137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.798550 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:55.803943 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1308/2597] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:55.804759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.813498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.814938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2454debb-a842-4cbb-a0df-5faf5e08e283 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.815064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.820040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.820699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.820979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.821248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] PATH_INFO: `/v3/projects/96598498621d465ea2656ccb2f62e9d6/users/84549c4e698e4188912ab1231065a071/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.823207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96598498621d465ea2656ccb2f62e9d6, user_id=84549c4e698e4188912ab1231065a071, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.824927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1290/2598] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:55.825651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.826221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ea908-d25f-49d7-884d-71551fbc63e4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.835580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb871b2-e4ad-469b-88b5-fa183f98f52d service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.848197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1309/2599] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:55 2022] PUT /identity/v3/projects/96598498621d465ea2656ccb2f62e9d6/users/84549c4e698e4188912ab1231065a071/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:55.850289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.850579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.850908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.883759 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] MFA Rules not processed for user `84549c4e698e4188912ab1231065a071`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:55.884822 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.897936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.898951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.899430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.899704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.900373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:55.900672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.902254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.914500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1291/2600] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:01:55.918693 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.926542 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:55.932363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c4912d-86b9-44ce-8228-7a1ddb7664b8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:55.937982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:55.938591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:55.938875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:55.939157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:55.941052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:55.942185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:55.973039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1310/2601] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:55.980023 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1292/2602] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/projects => generated 373 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:01:55.980192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.980807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:55.982481 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:55.992189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd304ee4-49b4-4d49-b973-9703547d7144 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.058867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342a3cc-d4e5-4b94-9711-44500ac51c8c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.065020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.065839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.066145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.066424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.080116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.080710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.080993 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.081806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.082446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.084425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.109291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1311/2603] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:55 2022] POST /identity/v3/users => generated 287 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:56.114126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.127274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72945b27-4ceb-4530-8ea0-fda67bab641a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.132907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.133660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.134232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.134587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.135312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.137502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.142470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.144896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.152771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1312/2604] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:56.154099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.158261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1293/2605] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:56.165178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5641c7-a183-4099-a4c9-74908dd665b7 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.169924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.170591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.170935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.171295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.172024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.173925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d62a31a-0659-427c-80b3-c6ec8ec92c8e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.307893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1313/2606] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:56 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:56.311987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.324989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b69298-87fe-4685-95e8-27726642d527 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.329147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.329809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.330082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.330352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] PATH_INFO: `/v3/projects/a0bc90eb4d8d4129a5db8003dd09b7a0/users/845a4c0db2ea4a87b85b26af530642af/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.344866 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:56.351507 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a0bc90eb4d8d4129a5db8003dd09b7a0, user_id=845a4c0db2ea4a87b85b26af530642af, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.354411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.375495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1294/2607] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:56 2022] PUT /identity/v3/projects/a0bc90eb4d8d4129a5db8003dd09b7a0/users/845a4c0db2ea4a87b85b26af530642af/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:56.386712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.386874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.387150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.427864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] MFA Rules not processed for user `845a4c0db2ea4a87b85b26af530642af`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:56.434195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:56.518050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1314/2608] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:56.529158 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.532621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:56.616630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.653831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:56.692429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786c6a32-8f7b-4fe8-9e74-f8a3ed956f50 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.698020 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.698653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.698926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.699334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] PATH_INFO: `/v3/users/7362f2682f174127ac98e158e97b3944` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.700517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7362f2682f174127ac98e158e97b3944)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.702415 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.746899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d9eb51-af13-461d-a4c8-1328318f1cf0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:56.753888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:56.754720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.755036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.755572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.764595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:56.765854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7362f2682f174127ac98e158e97b3944'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:56.766200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50013a-0402-435d-96d4-cf4fb69ba07d service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:56.766685 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7362f2682f174127ac98e158e97b3944'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:56.767324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7362f2682f174127ac98e158e97b3944'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:56.774773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7362f2682f174127ac98e158e97b3944'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:56.775696 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1295/2609] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:56 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:01:56.789220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7362f2682f174127ac98e158e97b3944'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:56.807767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1315/2610] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:56 2022] DELETE /identity/v3/users/7362f2682f174127ac98e158e97b3944 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:56.812796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:56.813936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:56.813936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:56.833965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:56.835392 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:56.916611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1296/2611] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:01:56.924675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:56.926825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:57.019960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278113c-7a1c-4251-8c6f-6face11789d4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:57.024288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:57.024906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:57.025164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:57.025429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:57.037590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:57.040233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:57.052595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1316/2612] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:01:57.377621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:57.379061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:57.391721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84480f04-fdc2-4bec-a4d8-33ddf6bd5046 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:57.396784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:57.397422 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:57.397699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:57.397967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] PATH_INFO: `/v3/projects/f29dbca1324a43e4af814c861611b1ef` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:57.399535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f29dbca1324a43e4af814c861611b1ef)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:57.401027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:57.462436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f29dbca1324a43e4af814c861611b1ef', 'request_id': 'req-fa28e578-2bba-49f6-a87b-a9b3d41a445e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.472739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f29dbca1324a43e4af814c861611b1ef', 'request_id': 'req-fa28e578-2bba-49f6-a87b-a9b3d41a445e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.479486 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f29dbca1324a43e4af814c861611b1ef', 'request_id': 'req-fa28e578-2bba-49f6-a87b-a9b3d41a445e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.492039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:57.497643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] The token cache is being invalidate because project f29dbca1324a43e4af814c861611b1ef was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:57.497901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.498770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.500790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1297/2613] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:57 2022] DELETE /identity/v3/projects/f29dbca1324a43e4af814c861611b1ef => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:57.505678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:57.517267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcd8202-5326-4526-b096-bc9ee9c22345 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:57.575380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:57.589064 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:57.589717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:57.590033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:57.590322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] PATH_INFO: `/v3/users/84549c4e698e4188912ab1231065a071` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:57.591607 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] RBAC: Authorizing `identity:delete_user(user_id=84549c4e698e4188912ab1231065a071)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:57.593725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:57.646077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84549c4e698e4188912ab1231065a071'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.648138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84549c4e698e4188912ab1231065a071'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.648866 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84549c4e698e4188912ab1231065a071'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.657300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84549c4e698e4188912ab1231065a071'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.672524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6cd4992d-3e7e-4745-acbe-470380bc0c5b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84549c4e698e4188912ab1231065a071'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:57.697229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1317/2614] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:57 2022] DELETE /identity/v3/users/84549c4e698e4188912ab1231065a071 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:58.170220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.171796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:58.185569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa28e578-2bba-49f6-a87b-a9b3d41a445e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.251658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.252247 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.252519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.252788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] PATH_INFO: `/v3/projects/96598498621d465ea2656ccb2f62e9d6` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.254494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96598498621d465ea2656ccb2f62e9d6)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.256745 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.319983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96598498621d465ea2656ccb2f62e9d6', 'request_id': 'req-a4910ee4-eadf-4840-9062-44014b764e42'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:58.328208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96598498621d465ea2656ccb2f62e9d6', 'request_id': 'req-a4910ee4-eadf-4840-9062-44014b764e42'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:58.338274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96598498621d465ea2656ccb2f62e9d6', 'request_id': 'req-a4910ee4-eadf-4840-9062-44014b764e42'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:58.357475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] The token cache is being invalidate because project 96598498621d465ea2656ccb2f62e9d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:58.357909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:58.359318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a4910ee4-eadf-4840-9062-44014b764e42 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:58.361344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1298/2615] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:58 2022] DELETE /identity/v3/projects/96598498621d465ea2656ccb2f62e9d6 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:58.366469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.366763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.367040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.404360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:58.405606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:58.494720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1318/2616] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:58.502542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.503584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.503675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.529577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:58.530834 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:58.539320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1299/2617] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:58.543801 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.555144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c7c791b-5c5a-4018-abde-69902f6a2ba6 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.560584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.561437 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.561644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.561912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.562555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:01:58.562849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.564590 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.578692 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1319/2618] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:01:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 05:01:58.583178 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.593279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7804d73-fba3-4376-8aae-2e95f1b31e33 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.599478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.600134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.600407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.600752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.601285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.603462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.634116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1300/2619] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:58 2022] POST /identity/v3/projects => generated 385 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:58.638169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.648428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a96b17b2-2fcb-4775-8ceb-e440024a8e7b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.741995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:58.756845 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.757898 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.758398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.758875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.760139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.767271 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.797469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1320/2620] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:58 2022] POST /identity/v3/users => generated 293 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:58.801946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.826014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bc7a74-a5e7-4cd1-b02e-81920d8d2fb5 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.831225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.831956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.832222 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.832496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.833174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.834778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.850421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1301/2621] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:58.851778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.864645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc46763-ccc2-48ea-850d-84661af6ab9c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.870055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.870851 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.871232 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.871510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.872331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.874420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd8c1b3-2916-422a-8253-4eed0aa92e39 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.887529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1321/2622] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:58 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:58.892246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:58.902692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a46b4d3b-07f0-46e1-bcbe-1a2a8398a881 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:58.908595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:58.909939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:58.910224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:58.910498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] PATH_INFO: `/v3/projects/6d886d783c74435e866c7aca5540363b/users/6ec618bc41364e87a38eee9f0d7afb40/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:58.931835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d886d783c74435e866c7aca5540363b, user_id=6ec618bc41364e87a38eee9f0d7afb40, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:58.934406 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:58.951784 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1302/2623] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:58 2022] PUT /identity/v3/projects/6d886d783c74435e866c7aca5540363b/users/6ec618bc41364e87a38eee9f0d7afb40/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:59.022952 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.023224 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.023506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.066967 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] MFA Rules not processed for user `6ec618bc41364e87a38eee9f0d7afb40`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:59.068533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.167907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1322/2624] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:59.170245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.205509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:59.247123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60b3b94-36c5-4494-b4e0-c55d4c786976 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.253380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.253981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.254345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.254618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.255511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.257512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.295005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1303/2625] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:59.296878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.308995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28caaa96-8e89-425c-9cdd-b1b22a86dc1d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.324536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.327163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.370765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.371375 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.371654 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.371953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.372578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.374502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.392407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631e305d-d3c9-446e-94aa-312f67ddce69 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.397164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1323/2626] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:01:59.397836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.398474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.398756 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.399049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] PATH_INFO: `/v3/users/65341da46cb04d5b898687920dcafc80` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.400199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=65341da46cb04d5b898687920dcafc80)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.401291 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.402104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.410918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5a38c1-e8db-4968-9747-b0339db82228 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.415530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.416141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.416422 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.416694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.417326 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.418885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.429399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1324/2627] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:01:59.433529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.444975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf4d6a2-1c2a-48aa-983d-6edd95684760 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.450740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.451651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.452152 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.452616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] PATH_INFO: `/v3/projects/1771b6cece3d4266abc5f7efc94e806c/users/4ff4a07d5d114bfd9c204e0a2aa91a75/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.457185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '65341da46cb04d5b898687920dcafc80'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.457879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '65341da46cb04d5b898687920dcafc80'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.458510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '65341da46cb04d5b898687920dcafc80'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.468957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1771b6cece3d4266abc5f7efc94e806c, user_id=4ff4a07d5d114bfd9c204e0a2aa91a75, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.470912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '65341da46cb04d5b898687920dcafc80'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.471643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.478331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '65341da46cb04d5b898687920dcafc80'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.485949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1325/2628] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:59 2022] PUT /identity/v3/projects/1771b6cece3d4266abc5f7efc94e806c/users/4ff4a07d5d114bfd9c204e0a2aa91a75/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:59.489813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.491165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1304/2629] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:59 2022] DELETE /identity/v3/users/65341da46cb04d5b898687920dcafc80 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:59.491671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.514342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:59.562647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf2c025-08fe-4f4c-be7d-0fa7d975ef26 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.619997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.620833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.621211 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.621926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.622818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.627512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.642171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1326/2630] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:01:59 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:01:59.644228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.659920 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c62607-81a6-4eda-a528-afd3edd7ebfb admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.660031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.660031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.664858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.664858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.664858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.664858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] PATH_INFO: `/v3/projects/1771b6cece3d4266abc5f7efc94e806c/users/4ff4a07d5d114bfd9c204e0a2aa91a75/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.665417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1771b6cece3d4266abc5f7efc94e806c, user_id=4ff4a07d5d114bfd9c204e0a2aa91a75, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.669442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.675297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca6388f-41fb-4268-a0d5-a81efb61e94a admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.681746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1305/2631] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:01:59 2022] PUT /identity/v3/projects/1771b6cece3d4266abc5f7efc94e806c/users/4ff4a07d5d114bfd9c204e0a2aa91a75/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:01:59.694606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:01:59.696793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.726528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:59.773305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.775077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.775513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.776336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] PATH_INFO: `/v3/users/845a4c0db2ea4a87b85b26af530642af` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.777741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=845a4c0db2ea4a87b85b26af530642af)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.779908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.789210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3865fb78-a98e-4c8c-af7e-22409cd6fc3d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:01:59.794542 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:01:59.795632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.795942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.796217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] PATH_INFO: `/v3/projects/5e2359dc2fb14576a17dc062995d1630` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.797772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e2359dc2fb14576a17dc062995d1630)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:01:59.801134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:01:59.837324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '845a4c0db2ea4a87b85b26af530642af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.838150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '845a4c0db2ea4a87b85b26af530642af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.838780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '845a4c0db2ea4a87b85b26af530642af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.847144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '845a4c0db2ea4a87b85b26af530642af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.855426 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:01:59.860530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e2359dc2fb14576a17dc062995d1630', 'request_id': 'req-c4d810a3-9868-4f6f-8237-4f500bb461d7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.864681 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-6b7f1ea9-9513-47e4-9e52-d6d4a9bd01ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '845a4c0db2ea4a87b85b26af530642af'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.870600 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e2359dc2fb14576a17dc062995d1630', 'request_id': 'req-c4d810a3-9868-4f6f-8237-4f500bb461d7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.881226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1327/2632] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:01:59 2022] DELETE /identity/v3/users/845a4c0db2ea4a87b85b26af530642af => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:59.882811 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.883095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.883366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.884751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e2359dc2fb14576a17dc062995d1630', 'request_id': 'req-c4d810a3-9868-4f6f-8237-4f500bb461d7'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.900034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] The token cache is being invalidate because project 5e2359dc2fb14576a17dc062995d1630 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:01:59.900327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.900998 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-c4d810a3-9868-4f6f-8237-4f500bb461d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:01:59.905832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1306/2633] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:01:59 2022] DELETE /identity/v3/projects/5e2359dc2fb14576a17dc062995d1630 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:01:59.905832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef85cc-6373-4325-a95e-daace1e52260 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.905832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef85cc-6373-4325-a95e-daace1e52260 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.905832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ef85cc-6373-4325-a95e-daace1e52260 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.917447 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] MFA Rules not processed for user `4ff4a07d5d114bfd9c204e0a2aa91a75`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:59.918910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.925893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-95ef85cc-6373-4325-a95e-daace1e52260 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:01:59.927114 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-95ef85cc-6373-4325-a95e-daace1e52260 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:01:59.989521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1307/2634] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:59.990782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:01:59.991068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:01:59.991338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:01:59.995653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1328/2635] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:01:59.999566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.000921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.013155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:00.014414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.022270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1308/2636] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:01:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:00.023072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.024303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.063752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d54579-3f01-4085-89d9-c23c46f12e6f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.068124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.068730 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.069022 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.069269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.070311 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:00.079386 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.081073 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ede9-0e16-4042-89ad-9708c54e50a0 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.085993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aab713d-291c-423c-86a4-f77ce2534318 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.090962 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1329/2637] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:01:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:00.092011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.092407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c457de-e907-419b-95b1-0077c730839d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.094884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c457de-e907-419b-95b1-0077c730839d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.095017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.095105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c457de-e907-419b-95b1-0077c730839d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.095205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.095205 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.096380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.114056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-14c457de-e907-419b-95b1-0077c730839d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:00.116258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-14c457de-e907-419b-95b1-0077c730839d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.133820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1330/2638] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:00.138148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c457de-e907-419b-95b1-0077c730839d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.148296 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c457de-e907-419b-95b1-0077c730839d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.154230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.154852 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.155438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.155860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.157115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:00.157418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.159916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.167284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.168968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.173167 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1331/2639] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 05:02:00.178412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.180771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1309/2640] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:00.190195 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce95f2a8-655c-47e5-8c20-cb7fb0f68566 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.195532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.196226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.196500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.196770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.197430 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.199403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.234353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1332/2641] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/projects => generated 387 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:00.239092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.250173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1db9f22-7140-499f-aff7-d7c4db57c066 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.320973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.321768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.322110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.322443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.323196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.325200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.350662 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1310/2642] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:00.354987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.366684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e779b5-4c20-44a6-8749-8f58cba4c605 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.372111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.373429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.373720 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.374149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.374750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.376656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.389450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1333/2643] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:00.394048 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.406515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.409031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.410024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05ab827-55d6-4926-814c-ca2c8c324ab4 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.416131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.416818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.417202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.417461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.418225 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.420041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.437777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1311/2644] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:00.445167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.449039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e73c3c7-d258-4060-9968-72aeed11b718 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.456241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.457058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.457399 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.457737 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] PATH_INFO: `/v3/projects/a0bc90eb4d8d4129a5db8003dd09b7a0` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.459638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a0bc90eb4d8d4129a5db8003dd09b7a0)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.461933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.464202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-286556d7-8c51-4eb7-bb41-12a21226148e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.469315 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.469973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.470245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.470517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] PATH_INFO: `/v3/projects/79bc8c304de7453dbf35884fcf7db299/users/0cd6bfca063647d7b26ee1f63d9d0424/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.474873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:00.489324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] RBAC: Authorizing `identity:create_grant(project_id=79bc8c304de7453dbf35884fcf7db299, user_id=0cd6bfca063647d7b26ee1f63d9d0424, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.492475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2e6d70-eaa5-490b-8b16-b26f07934ebc admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.508469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1312/2645] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:00 2022] PUT /identity/v3/projects/79bc8c304de7453dbf35884fcf7db299/users/0cd6bfca063647d7b26ee1f63d9d0424/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:00.521495 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.521750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a0bc90eb4d8d4129a5db8003dd09b7a0', 'request_id': 'req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:00.522220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.522527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.530553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a0bc90eb4d8d4129a5db8003dd09b7a0', 'request_id': 'req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:00.538915 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a0bc90eb4d8d4129a5db8003dd09b7a0', 'request_id': 'req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:00.551055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] The token cache is being invalidate because project a0bc90eb4d8d4129a5db8003dd09b7a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:00.551465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:00.552269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-add7b2c8-9097-472a-9ed2-0ab3ed4c9911 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:00.554673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1334/2646] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:00 2022] DELETE /identity/v3/projects/a0bc90eb4d8d4129a5db8003dd09b7a0 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:00.557900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] MFA Rules not processed for user `0cd6bfca063647d7b26ee1f63d9d0424`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:00.558904 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7249-48cd-4eff-a748-c86b420806d0 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.559515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7249-48cd-4eff-a748-c86b420806d0 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.559974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aab7249-48cd-4eff-a748-c86b420806d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.560093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.580085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7aab7249-48cd-4eff-a748-c86b420806d0 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:00.581917 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7aab7249-48cd-4eff-a748-c86b420806d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.640689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:00.677058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1313/2647] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:00.678165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.679498 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.680147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1335/2648] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:00.687406 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.687694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.687996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.702297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb36a59-97ad-4abf-9ce9-50360211d7d8 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.708067 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:00.708196 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.709078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.709335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:00.709442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.709603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.710361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.712515 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.717879 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1336/2649] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:00.722698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.731966 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5feff3bb-b644-4403-a00f-cfcf185fab18 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.739530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.739530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.739530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.739530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.739965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:00.739965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.740949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.747667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1314/2650] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/projects => generated 385 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:00.748596 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.753646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1337/2651] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:00.757978 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.770201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad202b1e-5dc4-4d6c-aee5-cfa2f19d0a5b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.809960 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e72fdfa-887e-4aaa-bc48-6173d0f9c734 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.814558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.815156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.815438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.815710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.816367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.818271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.826424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.827025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.827304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.827581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.828233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.830150 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.839342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1315/2652] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:00.843176 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.853451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae1bf86-25b5-40c0-85a1-ea07750fe2ba admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.858062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.858643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.858921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.859193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.859854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.861425 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.865455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1338/2653] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:00.866491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.874208 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1316/2654] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:00.874653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:00.875272 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.887559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d09cf7-ec94-45d0-a3db-b6f449304a68 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.932149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695200fe-d7ce-40bf-9528-ef9c4d888812 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.937023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.937636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.937914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.938187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.938812 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.941314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.943255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.943880 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.944159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.944431 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.945065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.946618 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.958426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1317/2655] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:00.962534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.965469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1339/2656] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:00 2022] POST /identity/v3/users => generated 303 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:00.966479 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:00.972381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2fa9c9-173e-4420-9844-5024e3235c7e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.976519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e0b6d1-75ec-4dc3-995e-686a57892054 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:00.977284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.977961 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.978240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.978513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] PATH_INFO: `/v3/projects/6b6ff247461343eb8fbedfb173196dc3/users/2a05a23a4dc548109472f923f52fe963/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.981109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:00.981683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:00.982024 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:00.982308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:00.982934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.984536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.993404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b6ff247461343eb8fbedfb173196dc3, user_id=2a05a23a4dc548109472f923f52fe963, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:00.994294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1340/2657] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:00.996068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b357661-ff91-4d4f-8722-0a7cad1189c0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:00.998162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.010328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1318/2658] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:00 2022] PUT /identity/v3/projects/6b6ff247461343eb8fbedfb173196dc3/users/2a05a23a4dc548109472f923f52fe963/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:01.010716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d378246-7758-45be-82d1-8910777fe8d5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.022331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.022612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.022887 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.035609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:01.050366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] MFA Rules not processed for user `2a05a23a4dc548109472f923f52fe963`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:01.051583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:01.070780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.071390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.071671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.071968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.072600 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.074187 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.085129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1341/2659] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:00 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:01.088987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.098402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061fda70-ba9f-430d-a6f2-f13ca7ac9a2f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.103244 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.103916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.104194 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.104491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] PATH_INFO: `/v3/projects/0d5071ea196d4df586f8944bf123a23d/users/f1e3cf3a2ac649a4a1256ad4d9ac38ed/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.115996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1319/2660] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:01 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:01.119493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d5071ea196d4df586f8944bf123a23d, user_id=f1e3cf3a2ac649a4a1256ad4d9ac38ed, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.120349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.121983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c0aa0e4-b8c8-4d7e-bee3-04da7951f94e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.132344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee17cc-282e-4004-b7e1-e965514ce553 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.135970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1342/2661] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:01 2022] PUT /identity/v3/projects/0d5071ea196d4df586f8944bf123a23d/users/f1e3cf3a2ac649a4a1256ad4d9ac38ed/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:01.141063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.141370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.141642 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.160309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:01.161571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:01.187950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.188794 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.189291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.189574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.190165 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.192685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.213287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:01.221134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1320/2662] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:01 2022] POST /identity/v3/projects => generated 385 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:01.225603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.226453 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1343/2663] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:01.235995 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.237913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:01.290279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01e490a-0b79-42fc-871d-cf19d29e38dd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.294858 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.295462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.295758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.296037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.296636 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fda9087-511d-4382-964b-8bf0fcd8e8f8 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.296759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.298591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.320321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1321/2664] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:01 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:01.324513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.334076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b0733a-4e6b-47fa-84ce-74469df8cde7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.338671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.339243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.339519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.339828 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.340462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.342078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.347948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:01.349390 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.350277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.350604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.350998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.354069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1322/2665] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:01.357826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.360673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.362083 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.368549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-572ad069-3551-4b81-a20a-15f958d0402f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.372837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1344/2666] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:01.373198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.373829 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.374106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.374372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] PATH_INFO: `/v3/projects/28b8532c3ce04acd8272b5fa59643b63/users/eb94b745bb4445bda2ae32c1013fc7d8/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.391577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8532c3ce04acd8272b5fa59643b63, user_id=eb94b745bb4445bda2ae32c1013fc7d8, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.394263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.407065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1323/2667] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:01 2022] PUT /identity/v3/projects/28b8532c3ce04acd8272b5fa59643b63/users/eb94b745bb4445bda2ae32c1013fc7d8/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:01.411145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.422090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea28990-0c1c-488c-9bb6-faaee209ea47 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.485752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.486361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.486729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.487005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.488233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.489864 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d164481-7205-4202-8b63-5dd584722c99 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.502679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1345/2668] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:01 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:01.504726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.515443 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32e435ab-93c0-487a-bbd2-9c666275aee3 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.520383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.521038 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.521314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.521586 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] PATH_INFO: `/v3/projects/28b8532c3ce04acd8272b5fa59643b63/users/eb94b745bb4445bda2ae32c1013fc7d8/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.523979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] RBAC: Authorizing `identity:create_grant(project_id=28b8532c3ce04acd8272b5fa59643b63, user_id=eb94b745bb4445bda2ae32c1013fc7d8, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.528044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.539475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1324/2669] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:01 2022] PUT /identity/v3/projects/28b8532c3ce04acd8272b5fa59643b63/users/eb94b745bb4445bda2ae32c1013fc7d8/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:01.549428 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8de02-efd3-4ffb-9c7d-7963ad71a358 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.550238 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8de02-efd3-4ffb-9c7d-7963ad71a358 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.550509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c8de02-efd3-4ffb-9c7d-7963ad71a358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.579178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b8c8de02-efd3-4ffb-9c7d-7963ad71a358 None None] MFA Rules not processed for user `eb94b745bb4445bda2ae32c1013fc7d8`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:01.580438 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b8c8de02-efd3-4ffb-9c7d-7963ad71a358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:01.623404 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:01.666155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1346/2670] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:01 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:01.677395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:01.680279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:01.770900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53e7547-c87a-45ff-962e-2d0299880fdd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:01.786159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:01.788675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:01.789527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:01.790288 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:01.812993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:01.815799 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:01.835789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1325/2671] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:01 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:02.136309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.136805 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.137240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.172337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] MFA Rules not processed for user `f1e3cf3a2ac649a4a1256ad4d9ac38ed`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:02.173950 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:02.259887 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1347/2672] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:02 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:02.262546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.335894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab88cd-e718-422c-bf96-2d3279147000 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.340885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.341561 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.341906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.342262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.342979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.345029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.383765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1326/2673] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:02 2022] POST /identity/v3/projects => generated 405 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:02.386947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.398374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a9e388-a3d1-414f-8d8c-d54db0fca454 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.465613 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.466229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.466503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.466771 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.467409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.469377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.490345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1348/2674] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:02 2022] POST /identity/v3/users => generated 309 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:02.494434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.504931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57eaa55-8524-479c-8cf3-167e2ca59c0c admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.509760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.510351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.510624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.510888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.511512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.513140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.524126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1327/2675] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:02.527461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.528383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.538567 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34464866-967e-44af-bb5d-fd91bc697300 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.543271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.544029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.544374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.544712 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] PATH_INFO: `/v3/projects/029e26f509be48e78f7791ea5333c5c8/users/7cf5db49e7d442a2b81975d0868b85b5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.559588 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029e26f509be48e78f7791ea5333c5c8, user_id=7cf5db49e7d442a2b81975d0868b85b5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.562229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.575382 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1328/2676] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:02 2022] PUT /identity/v3/projects/029e26f509be48e78f7791ea5333c5c8/users/7cf5db49e7d442a2b81975d0868b85b5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:02.579408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.583586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49eb24dd-b578-40c6-be19-50f1a9ffb686 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.592659 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:02.598009 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:02.635361 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.635976 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.636252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.636632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.643149 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd98af8-0258-4a16-966f-6d6f06e2b153 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.648730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.649501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.649954 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.650312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.651292 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.652919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.663952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1329/2677] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:02 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:02.668090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:02.678632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fb2535-3b2c-4464-b3bb-b516af896f7f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:02.683652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:02.684334 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:02.684614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:02.684904 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] PATH_INFO: `/v3/projects/029e26f509be48e78f7791ea5333c5c8/users/7cf5db49e7d442a2b81975d0868b85b5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:02.687051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=029e26f509be48e78f7791ea5333c5c8, user_id=7cf5db49e7d442a2b81975d0868b85b5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.689685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433cef0f-e923-4a15-acb3-9df0702d49c0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.694583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:02.696047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:02.700331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1330/2678] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:02 2022] PUT /identity/v3/projects/029e26f509be48e78f7791ea5333c5c8/users/7cf5db49e7d442a2b81975d0868b85b5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:02.704973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1349/2679] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:02 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:03.618109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:03.618584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:03.618929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:03.648243 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] MFA Rules not processed for user `7cf5db49e7d442a2b81975d0868b85b5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:03.649366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:03.720818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1331/2680] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:03 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:04.645821 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:04.654322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceff95c9-d156-4341-b491-8f8d1d799597 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:04.705301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:04.705926 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:04.706201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:04.706463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:04.708220 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:04.781233 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:04.781403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:04.782965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:04.794772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1350/2681] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:04 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:04.849014 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380ef112-c1f2-4779-a89c-c408b20855e6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:04.855510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:04.856301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:04.856616 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:04.856894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] PATH_INFO: `/v3/users/f1e3cf3a2ac649a4a1256ad4d9ac38ed` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:04.858424 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e3cf3a2ac649a4a1256ad4d9ac38ed)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:04.861073 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:04.890133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:04.910965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e3cf3a2ac649a4a1256ad4d9ac38ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:04.911620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e3cf3a2ac649a4a1256ad4d9ac38ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:04.912291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e3cf3a2ac649a4a1256ad4d9ac38ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:04.926108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e3cf3a2ac649a4a1256ad4d9ac38ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:04.933768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e3cf3a2ac649a4a1256ad4d9ac38ed'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:04.948766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1332/2682] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:04 2022] DELETE /identity/v3/users/f1e3cf3a2ac649a4a1256ad4d9ac38ed => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:05.141833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:05.156367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740c3890-4f37-4f12-bec6-7b70b9492075 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:05.177078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:05.224603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:05.225237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.225515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.225786 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] PATH_INFO: `/v3/projects/0d5071ea196d4df586f8944bf123a23d` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.226918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d5071ea196d4df586f8944bf123a23d)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:05.228849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:05.278519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d5071ea196d4df586f8944bf123a23d', 'request_id': 'req-a44d3a14-fb31-432e-a7d9-7d3095b47b16'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.289834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d5071ea196d4df586f8944bf123a23d', 'request_id': 'req-a44d3a14-fb31-432e-a7d9-7d3095b47b16'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.297010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d5071ea196d4df586f8944bf123a23d', 'request_id': 'req-a44d3a14-fb31-432e-a7d9-7d3095b47b16'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.307762 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] The token cache is being invalidate because project 0d5071ea196d4df586f8944bf123a23d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:05.308138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.308863 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.310396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1351/2683] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:05 2022] DELETE /identity/v3/projects/0d5071ea196d4df586f8944bf123a23d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:05.314319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:05.315751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:05.328732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9485e00-df7c-4203-b37d-7225a016efd8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:05.386133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:05.386764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.387045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.387312 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] PATH_INFO: `/v3/users/7cf5db49e7d442a2b81975d0868b85b5` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.388461 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] RBAC: Authorizing `identity:delete_user(user_id=7cf5db49e7d442a2b81975d0868b85b5)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:05.390372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:05.450316 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7cf5db49e7d442a2b81975d0868b85b5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.451774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7cf5db49e7d442a2b81975d0868b85b5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.452746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7cf5db49e7d442a2b81975d0868b85b5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.468573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7cf5db49e7d442a2b81975d0868b85b5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.476042 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d577b722-4c45-48cd-991d-6eeef7dde22b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7cf5db49e7d442a2b81975d0868b85b5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.490087 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1333/2684] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:05 2022] DELETE /identity/v3/users/7cf5db49e7d442a2b81975d0868b85b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:05.676090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:05.676090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:05.689162 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44d3a14-fb31-432e-a7d9-7d3095b47b16 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:05.746298 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:05.746846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.747120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.747385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] PATH_INFO: `/v3/projects/029e26f509be48e78f7791ea5333c5c8` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.748511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=029e26f509be48e78f7791ea5333c5c8)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:05.750398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:05.797089 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '029e26f509be48e78f7791ea5333c5c8', 'request_id': 'req-84c2601f-ca15-4611-98fa-205579fcbad7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.798732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:05.805831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '029e26f509be48e78f7791ea5333c5c8', 'request_id': 'req-84c2601f-ca15-4611-98fa-205579fcbad7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.812923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '029e26f509be48e78f7791ea5333c5c8', 'request_id': 'req-84c2601f-ca15-4611-98fa-205579fcbad7'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.823935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] The token cache is being invalidate because project 029e26f509be48e78f7791ea5333c5c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:05.824221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.824859 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-84c2601f-ca15-4611-98fa-205579fcbad7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:05.826328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1352/2685] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:05 2022] DELETE /identity/v3/projects/029e26f509be48e78f7791ea5333c5c8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:05.831562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.832082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.832175 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.851284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:05.852522 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:05.869410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:05.912666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1334/2686] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:05.920392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.920677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.920948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.941691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:05.943055 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:05.950912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1353/2687] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:05.955194 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:05.964936 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2678ef4-93f3-4911-8947-222347d9f257 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:05.969355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:05.969943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:05.970217 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:05.970484 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:05.971115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:05.971412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:05.973045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:05.984137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1335/2688] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:05.988862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:05.998058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f85e747-7f68-4057-b5fc-b34aa6e4d7cc None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.003299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.003920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.004214 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.004468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.005356 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.007237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.043400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1354/2689] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:05 2022] POST /identity/v3/projects => generated 373 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:06.048065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.061796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf96db8c-b384-4d6e-b805-4b3369bf3370 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.118536 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.119142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.120064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.120343 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.120980 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.122934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.146760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1336/2690] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:06 2022] POST /identity/v3/users => generated 287 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:06.150819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.165830 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f139146f-6853-4236-bda3-53a7d77cf920 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.170788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.171442 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.171749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.172028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.172669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.174376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.185502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1355/2691] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:06.189640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.199655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a32ad39-9914-434f-96eb-5cd7af278b2b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.204264 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.204856 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.205134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.205434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.206109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.207836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0174f1-bf44-451f-9091-93783ed0f0d6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.226041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1337/2692] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:06.227109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.239700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc71a2f6-ee8d-4ea7-b688-f4c2784857f2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.253569 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.254306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.254591 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.254862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] PATH_INFO: `/v3/projects/66857150ee7444cd8e928ad950a7e02b/users/ee4897153ad74277a3dd447ebd767e9f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.270288 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=66857150ee7444cd8e928ad950a7e02b, user_id=ee4897153ad74277a3dd447ebd767e9f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.272973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.287609 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1356/2693] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:06 2022] PUT /identity/v3/projects/66857150ee7444cd8e928ad950a7e02b/users/ee4897153ad74277a3dd447ebd767e9f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:06.292864 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.293152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.293442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.314310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:06.315642 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:06.378893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1338/2694] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:06.389028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.390736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:06.455166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7608122-4929-4a76-9f07-bab356e630a0 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.458908 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.459513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.459825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.460102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.469286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.470869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34311c66-4219-4d5b-ba3f-19bc5335ae26 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.481888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1357/2695] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:06.816575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:06.817934 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:06.873501 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:06.907759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ce299c-8735-4e98-b872-c3e5a7abe1f4 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:06.911487 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:06.912126 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:06.912427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:06.912673 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:06.914576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:06.978160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:06.979591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:06.988803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1339/2696] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:06 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:07.140088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.140578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.140665 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.174996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] MFA Rules not processed for user `ee4897153ad74277a3dd447ebd767e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:07.177036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:07.254053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=3,keystone:DELETE=3,keystone:SELECT=94 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:07.261429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1358/2697] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:07.265926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.277328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed0df32-8a4f-4321-9fb9-0e7c5534af89 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.281798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.282409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.282687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.282985 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.283622 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.285577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.320015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1340/2698] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:07 2022] POST /identity/v3/projects => generated 373 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:07.320974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.332245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a84852e0-03c6-4655-b4b5-c89d0dd6ac63 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.400009 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.400732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.401078 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.401418 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.402112 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.404135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.426630 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1359/2699] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:07 2022] POST /identity/v3/users => generated 293 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:07.433403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.445721 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05876cc2-7683-4af3-80fe-962f5f0248a9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.456304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.456304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.456304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.456304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.456726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.459930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.471808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1341/2700] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:07.476111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.490149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a763b0e6-0157-446d-8971-36ae8d844d96 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.494945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.495601 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.495913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.496207 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] PATH_INFO: `/v3/projects/0eff43f752dd43498140be9596278097/users/6727eb13eebc4e4cb5aa65b7bf7391a5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.515401 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eff43f752dd43498140be9596278097, user_id=6727eb13eebc4e4cb5aa65b7bf7391a5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.518593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.535062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1360/2701] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:07 2022] PUT /identity/v3/projects/0eff43f752dd43498140be9596278097/users/6727eb13eebc4e4cb5aa65b7bf7391a5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:07.539221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.553314 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20509b6-2536-4d0b-81c1-cade88f0f098 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.626191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.626832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.627109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.627376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.628691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.630534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb0b8c91-eb2b-47ed-a4f5-46cc1c29e4c3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.641516 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1342/2702] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:07 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:07.645076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:07.655945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb54f15-7b26-44e6-ba0f-0bffa10e4bb8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:07.661673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:07.662392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:07.662735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:07.663066 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] PATH_INFO: `/v3/projects/0eff43f752dd43498140be9596278097/users/6727eb13eebc4e4cb5aa65b7bf7391a5/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:07.665036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eff43f752dd43498140be9596278097, user_id=6727eb13eebc4e4cb5aa65b7bf7391a5, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:07.667890 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4003d749-6d60-4fbd-b181-b9e224a51c51 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:07.680742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1361/2703] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:07 2022] PUT /identity/v3/projects/0eff43f752dd43498140be9596278097/users/6727eb13eebc4e4cb5aa65b7bf7391a5/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:08.320650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:08.321207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:08.321207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:08.351556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] MFA Rules not processed for user `6727eb13eebc4e4cb5aa65b7bf7391a5`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:08.352751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:08.388779 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:08.425129 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1343/2704] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:08.436555 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:08.437132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:08.437132 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:08.457255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] MFA Rules not processed for user `ee4897153ad74277a3dd447ebd767e9f`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:08.458241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:08.514030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1362/2705] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:08.528308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:08.529789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:08.602638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e49e298-2b5f-4d01-9f63-767d5a328821 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:08.608035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:08.608643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:08.608916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:08.609271 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:08.617022 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:08.618738 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc461e6d-025a-4423-ba9d-75eb96fc69b8 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:08.627352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1344/2706] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:09.170032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.171496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.245804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:09.252554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3da815c-106e-4fbf-856b-c5cd98123759 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:09.259618 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:09.260480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.260831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.261171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] PATH_INFO: `/v3/users/0cd6bfca063647d7b26ee1f63d9d0424` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.262530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cd6bfca063647d7b26ee1f63d9d0424)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:09.264667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:09.314571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cd6bfca063647d7b26ee1f63d9d0424'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.315260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cd6bfca063647d7b26ee1f63d9d0424'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.315964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cd6bfca063647d7b26ee1f63d9d0424'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.323516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cd6bfca063647d7b26ee1f63d9d0424'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.335901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cd6bfca063647d7b26ee1f63d9d0424'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.350687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1363/2707] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:09 2022] DELETE /identity/v3/users/0cd6bfca063647d7b26ee1f63d9d0424 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:09.355090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.355584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.355691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.375084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:09.376223 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.457527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1345/2708] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:09.470063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.472135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.537841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc238fa8-5eca-443b-85cc-053683964ff5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:09.541641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:09.542248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.542523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.542791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.552299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:09.553740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:09.563927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1364/2709] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:09.740053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.741621 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.753434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8de3d-67ec-4a37-a45d-afb1f7ec458e None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:09.758321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:09.758959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.759233 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.759506 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] PATH_INFO: `/v3/users/6ec618bc41364e87a38eee9f0d7afb40` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.760668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6ec618bc41364e87a38eee9f0d7afb40)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:09.762572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:09.816041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6ec618bc41364e87a38eee9f0d7afb40'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.817218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6ec618bc41364e87a38eee9f0d7afb40'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.817407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6ec618bc41364e87a38eee9f0d7afb40'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.828069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:09.846206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6ec618bc41364e87a38eee9f0d7afb40'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.854926 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-723b6c7c-e843-44c0-9056-4cc1f5dc0607 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6ec618bc41364e87a38eee9f0d7afb40'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.860056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.862032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.882364 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db7bd6c-91c4-40c8-8e30-d3c7849ccf4c service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:09.885417 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1346/2710] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:09 2022] DELETE /identity/v3/users/6ec618bc41364e87a38eee9f0d7afb40 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:09.887362 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:09.888213 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.888391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.888661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] PATH_INFO: `/v3/projects/79bc8c304de7453dbf35884fcf7db299` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.889807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79bc8c304de7453dbf35884fcf7db299)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:09.890231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:09.890685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:09.891206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:09.891694 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:09.914246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:09.915399 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.946100 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79bc8c304de7453dbf35884fcf7db299', 'request_id': 'req-38623ee2-d87c-42f0-87d5-707112c6ae08'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.957370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79bc8c304de7453dbf35884fcf7db299', 'request_id': 'req-38623ee2-d87c-42f0-87d5-707112c6ae08'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.964270 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79bc8c304de7453dbf35884fcf7db299', 'request_id': 'req-38623ee2-d87c-42f0-87d5-707112c6ae08'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.972392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:09.977323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] The token cache is being invalidate because project 79bc8c304de7453dbf35884fcf7db299 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:09.977785 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.978937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:09.980931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1365/2711] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:09 2022] DELETE /identity/v3/projects/79bc8c304de7453dbf35884fcf7db299 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:09.984675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.984825 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1347/2712] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:09.986819 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:09.994301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:09.995609 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:10.052188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38623ee2-d87c-42f0-87d5-707112c6ae08 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.054524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad0ba7-ebf4-41b1-85d5-d588c5e60635 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.056873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.057503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.057779 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.058051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] PATH_INFO: `/v3/users/2a05a23a4dc548109472f923f52fe963` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.059163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a05a23a4dc548109472f923f52fe963)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.061102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.104090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.104717 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.104990 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.105262 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.107441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a05a23a4dc548109472f923f52fe963'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.108099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a05a23a4dc548109472f923f52fe963'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.108691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a05a23a4dc548109472f923f52fe963'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.114187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.115530 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a05a23a4dc548109472f923f52fe963'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.115649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.124947 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1348/2713] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:10.128402 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a05a23a4dc548109472f923f52fe963'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.142382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1366/2714] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:09 2022] DELETE /identity/v3/users/2a05a23a4dc548109472f923f52fe963 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:10.545929 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:10.547445 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:10.566614 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08f485a-a61c-4b4e-b8c7-f69f0b518dd0 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.605729 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:10.607277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:10.614740 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:10.675182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.675775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.676063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.676345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] PATH_INFO: `/v3/projects/6d886d783c74435e866c7aca5540363b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.677706 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d886d783c74435e866c7aca5540363b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.679607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.708649 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bf9de77-cb13-432c-a5ba-6677339814cd admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.714104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.715860 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.716147 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.716421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] PATH_INFO: `/v3/projects/6b6ff247461343eb8fbedfb173196dc3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.717601 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b6ff247461343eb8fbedfb173196dc3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.719682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.745742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d886d783c74435e866c7aca5540363b', 'request_id': 'req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.749874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:10.756376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d886d783c74435e866c7aca5540363b', 'request_id': 'req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.766743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d886d783c74435e866c7aca5540363b', 'request_id': 'req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.782291 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] The token cache is being invalidate because project 6d886d783c74435e866c7aca5540363b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:10.782612 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.783267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.785512 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1349/2715] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:10 2022] DELETE /identity/v3/projects/6d886d783c74435e866c7aca5540363b => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:10.786968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b6ff247461343eb8fbedfb173196dc3', 'request_id': 'req-8787f16a-4294-4607-a43d-d31a783e1b0f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.789877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:10.792412 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:10.800432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b6ff247461343eb8fbedfb173196dc3', 'request_id': 'req-8787f16a-4294-4607-a43d-d31a783e1b0f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.809650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b6ff247461343eb8fbedfb173196dc3', 'request_id': 'req-8787f16a-4294-4607-a43d-d31a783e1b0f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.822726 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] The token cache is being invalidate because project 6b6ff247461343eb8fbedfb173196dc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:10.823023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.823942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.825886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1367/2716] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:10 2022] DELETE /identity/v3/projects/6b6ff247461343eb8fbedfb173196dc3 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:10.829581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:10.830870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:10.864795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8839c049-b7b1-4ed1-81f0-bd5ca5fa4a4b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.906907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787f16a-4294-4607-a43d-d31a783e1b0f admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:10.912474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.913118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.913536 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.913818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] PATH_INFO: `/v3/users/eb94b745bb4445bda2ae32c1013fc7d8` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.915077 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb94b745bb4445bda2ae32c1013fc7d8)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.917072 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.946438 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:10.947155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:10.947792 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:10.948134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] PATH_INFO: `/v3/users/4ff4a07d5d114bfd9c204e0a2aa91a75` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:10.949906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4ff4a07d5d114bfd9c204e0a2aa91a75)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:10.953122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:10.963511 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:10.976053 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb94b745bb4445bda2ae32c1013fc7d8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.976874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb94b745bb4445bda2ae32c1013fc7d8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.977517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb94b745bb4445bda2ae32c1013fc7d8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:10.990503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb94b745bb4445bda2ae32c1013fc7d8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.019104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb94b745bb4445bda2ae32c1013fc7d8'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.024177 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4ff4a07d5d114bfd9c204e0a2aa91a75'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.025691 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4ff4a07d5d114bfd9c204e0a2aa91a75'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.027062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4ff4a07d5d114bfd9c204e0a2aa91a75'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.040136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1368/2717] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:10 2022] DELETE /identity/v3/users/eb94b745bb4445bda2ae32c1013fc7d8 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:11.053917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4ff4a07d5d114bfd9c204e0a2aa91a75'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.062806 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-32cc9f18-5ee3-43ab-a189-f7a89f3dbc9f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4ff4a07d5d114bfd9c204e0a2aa91a75'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.084823 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1350/2718] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:10 2022] DELETE /identity/v3/users/4ff4a07d5d114bfd9c204e0a2aa91a75 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:11.331964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:11.334048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.383433 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:11.419011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bca298-6282-4206-be19-bcea8cd12445 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:11.504682 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:11.505583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.505858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.506127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] PATH_INFO: `/v3/projects/28b8532c3ce04acd8272b5fa59643b63` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.507533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28b8532c3ce04acd8272b5fa59643b63)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:11.509486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:11.569518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28b8532c3ce04acd8272b5fa59643b63', 'request_id': 'req-f5413a61-113d-446d-8df4-55b4bddc3358'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.578792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28b8532c3ce04acd8272b5fa59643b63', 'request_id': 'req-f5413a61-113d-446d-8df4-55b4bddc3358'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.586408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28b8532c3ce04acd8272b5fa59643b63', 'request_id': 'req-f5413a61-113d-446d-8df4-55b4bddc3358'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.599991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] The token cache is being invalidate because project 28b8532c3ce04acd8272b5fa59643b63 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:11.600444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.601556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f5413a61-113d-446d-8df4-55b4bddc3358 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.603769 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1369/2719] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:11 2022] DELETE /identity/v3/projects/28b8532c3ce04acd8272b5fa59643b63 => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:11.610882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748420-2162-4ca9-895b-a6de298221de None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.611526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748420-2162-4ca9-895b-a6de298221de None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.611526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3748420-2162-4ca9-895b-a6de298221de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.632439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f3748420-2162-4ca9-895b-a6de298221de None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:11.633658 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f3748420-2162-4ca9-895b-a6de298221de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.697093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1351/2720] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:11.706199 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.706711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.707303 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.716800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748420-2162-4ca9-895b-a6de298221de None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:11.720607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f3748420-2162-4ca9-895b-a6de298221de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.730934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:11.732925 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.741108 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3748420-2162-4ca9-895b-a6de298221de None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:11.744389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1370/2721] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:11.748024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:11.748690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.748971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.749248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] PATH_INFO: `/v3/projects/1771b6cece3d4266abc5f7efc94e806c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.749911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:11.758963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=1771b6cece3d4266abc5f7efc94e806c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:11.760952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:11.768036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f24f67-c8c4-4e5d-acc0-2954a0c5b94e None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:11.773664 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:11.774480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.774912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.775358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.776218 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:11.776721 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:11.778473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:11.792360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1371/2722] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:11.796867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:11.808189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b6f123-8ce6-4e97-ac7d-43e0f2cc7c93 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:11.817677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1771b6cece3d4266abc5f7efc94e806c', 'request_id': 'req-0adb7089-1b70-4eed-a802-78cd569aebdb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.824244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1771b6cece3d4266abc5f7efc94e806c', 'request_id': 'req-0adb7089-1b70-4eed-a802-78cd569aebdb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.830640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1771b6cece3d4266abc5f7efc94e806c', 'request_id': 'req-0adb7089-1b70-4eed-a802-78cd569aebdb'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.846465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] The token cache is being invalidate because project 1771b6cece3d4266abc5f7efc94e806c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:11.846758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.847979 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-0adb7089-1b70-4eed-a802-78cd569aebdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:11.849161 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1352/2723] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:11 2022] DELETE /identity/v3/projects/1771b6cece3d4266abc5f7efc94e806c => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:11.855146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8326-15e2-45d7-ae8d-8dd89d595416 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.855428 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8326-15e2-45d7-ae8d-8dd89d595416 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.855698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ddc8326-15e2-45d7-ae8d-8dd89d595416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.858651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:11.879282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-6ddc8326-15e2-45d7-ae8d-8dd89d595416 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:11.879697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:11.880594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.880874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.881135 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.881328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6ddc8326-15e2-45d7-ae8d-8dd89d595416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.881772 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:11.883775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:11.889649 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1353/2724] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:11.899500 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:11.900736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:11.900736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:11.908384 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:11.915776 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1372/2725] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/projects => generated 383 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:11.919749 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:11.921905 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.923324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:11.925170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:11.991465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1354/2726] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:11.995462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a63c7f7-2c52-43f2-b924-d27c1674f9bd admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:11.995999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.001930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.003360 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.004226 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.004526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.005549 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.007206 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb23f49f-d790-4e2f-bb3d-269cd12852f5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.007703 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.013902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.014645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.014931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.015202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.015881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:12.016183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.017768 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.030822 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1355/2727] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 20 05:02:12.035079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1373/2728] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:11 2022] POST /identity/v3/users => generated 292 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:12.035627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.036108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.046798 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3bd25af-fce7-42a3-aefb-0f7134db2729 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.047551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e58daf-cc9a-4da4-9462-c42f290c3eea admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.054078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.054725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.054999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.055276 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.055444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.055948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.056277 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.056679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.057062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.057865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.058086 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.060261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.075766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1374/2729] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:12.081348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.092788 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1356/2730] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/projects => generated 385 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:12.093204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cb6686-32c9-433e-8272-00d75b373e36 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.096906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.160916 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.161666 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.162046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.162419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.163157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.164888 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.179372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1375/2731] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:12.180496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.181490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574a961f-4644-4db7-9b48-13690996203a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.186454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.187065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.187338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.187749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.188434 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.190523 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.190961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5da5474-747e-40f5-a953-6c02c73aa5f5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.201129 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.201910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.202325 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.202770 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] PATH_INFO: `/v3/projects/1175af3eea264fa39dccc1685c066b38/users/31c45d25d92c468b85987721e742fb1b/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.215625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1357/2732] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/users => generated 293 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:12.216890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.225627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1175af3eea264fa39dccc1685c066b38, user_id=31c45d25d92c468b85987721e742fb1b, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.228742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.230766 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca03602-23e6-4a80-a4b3-0c4626bcef02 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.236146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.237325 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.237606 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.237894 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.238547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.240330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b13afdee-16d7-49b7-8320-9b17fc4fc262 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.246948 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1376/2733] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:12 2022] PUT /identity/v3/projects/1175af3eea264fa39dccc1685c066b38/users/31c45d25d92c468b85987721e742fb1b/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:12.251104 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1358/2734] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:12.256123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.259558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.259952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.260369 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.286208 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:12.291818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] MFA Rules not processed for user `31c45d25d92c468b85987721e742fb1b`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:12.293159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:12.329782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a2c021-2a13-456f-b9df-1f5213a3d040 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.333624 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:12.336459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.337374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.337741 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.338070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.338796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.340912 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.354103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1377/2735] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:12.358856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.371674 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b287a7fe-3fc8-4b13-bc2f-fc0df4f4c722 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.378362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1359/2736] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:12.379274 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.381503 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.381787 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.382573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] PATH_INFO: `/v3/projects/47a3bd1278e549ab9350839d65f8e553/users/9e0c0f95071448dcab8463099514bed2/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.384263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.399759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc5208b2-67f8-4e39-860e-fb80210a04cb None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.403612 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a3bd1278e549ab9350839d65f8e553, user_id=9e0c0f95071448dcab8463099514bed2, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.405210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.405830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.406112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.406272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efdb862-bd3b-4d51-a85a-56e16d75aa9f admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.406374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.407027 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.409882 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.423774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1378/2737] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:12 2022] PUT /identity/v3/projects/47a3bd1278e549ab9350839d65f8e553/users/9e0c0f95071448dcab8463099514bed2/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:12.436416 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.436874 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.437016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.456136 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1360/2738] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/projects => generated 381 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:12.459951 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.467514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] MFA Rules not processed for user `9e0c0f95071448dcab8463099514bed2`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:12.468854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:12.529182 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95e8024-311f-40a1-9d03-e8bce94d119d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.534551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.535163 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.535441 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.535711 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.536376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.538338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.539902 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1379/2739] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:12.544267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.555105 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c0ad3-4296-4a70-bede-c48f2d2b72b9 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.560032 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.560715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.561068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.561412 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.562114 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.563802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1361/2740] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/users => generated 297 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:12.564321 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.567636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.577681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5b0ad2-5397-484a-afa7-72baeefe67bd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.582973 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.583565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.585329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.585657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.586456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.588654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.601001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1380/2741] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:12.601236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1362/2742] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:12.601983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.605534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.615364 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b91581-b600-4323-849d-c33241103b6b admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.685984 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3543a6b-6d60-429d-bae0-c77f23f3a5d5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.691632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.692355 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.692861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.693071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.693953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.695994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.706901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:12.712850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.713610 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.714039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.715075 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] PATH_INFO: `/v3/projects/2926907151af4351b2fd001b55ae4acf/users/1c49ab127cf04d8b9d8afd7721701f83/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.731104 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1381/2743] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/users => generated 292 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:12.732498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.732770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2926907151af4351b2fd001b55ae4acf, user_id=1c49ab127cf04d8b9d8afd7721701f83, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.735572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.756144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1363/2744] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:12 2022] PUT /identity/v3/projects/2926907151af4351b2fd001b55ae4acf/users/1c49ab127cf04d8b9d8afd7721701f83/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:12.760617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.762221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f314db-5b81-48e3-8166-8dd6fbdfdecd admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.782519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:12.839203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d022b757-bcaa-43e6-9689-3c606ff2ea00 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.844195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.844800 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.845084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.845358 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.846045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.848171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.855561 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.856124 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.856400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.856675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.857305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.859774 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1364/2745] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:12.859961 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.862835 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.873279 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddf1560-ea27-4094-bca9-242aff7c2c68 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.873463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1382/2746] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:12.877138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.878907 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.879565 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.880253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.880535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] PATH_INFO: `/v3/projects/2926907151af4351b2fd001b55ae4acf/users/1c49ab127cf04d8b9d8afd7721701f83/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.882462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2926907151af4351b2fd001b55ae4acf, user_id=1c49ab127cf04d8b9d8afd7721701f83, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.885141 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7401141c-3c96-433c-aa32-f61503ad2f46 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.887553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff90d12b-9d5f-40eb-b619-ef6f0c123383 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.892186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.892791 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.893657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.893930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.894548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.896016 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1365/2747] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:12 2022] PUT /identity/v3/projects/2926907151af4351b2fd001b55ae4acf/users/1c49ab127cf04d8b9d8afd7721701f83/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:12.896138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:12.906184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.906470 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.906680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1383/2748] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:12.906808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.910576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:12.921847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2a7832-b019-40b5-a9d7-7860ff5c1030 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:12.934525 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] MFA Rules not processed for user `1c49ab127cf04d8b9d8afd7721701f83`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:12.935906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:12.977357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:12.978008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:12.978281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:12.978543 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] PATH_INFO: `/v3/projects/e8df675c0aff45aeb1c9ac0117d742c8/users/3e213b2b82ab47d586a917969b16df03/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:12.992410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8df675c0aff45aeb1c9ac0117d742c8, user_id=3e213b2b82ab47d586a917969b16df03, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:12.995093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a429cb-efa0-40da-9e3b-b19fe841252b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.005899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1366/2749] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:12 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:13.009082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1384/2750] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:12 2022] PUT /identity/v3/projects/e8df675c0aff45aeb1c9ac0117d742c8/users/3e213b2b82ab47d586a917969b16df03/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:13.019122 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.019660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.019991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.020259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.020602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:13.047130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] MFA Rules not processed for user `3e213b2b82ab47d586a917969b16df03`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:13.048385 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:13.076962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d70e9162-3710-4fb6-a614-403d5903009b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.093911 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:13.113526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1385/2751] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:13.115387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:13.118564 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.128651 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.129346 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.129659 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.130216 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.184608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee39d27-5004-4c29-a686-894587b3624d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.189460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.190592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.190726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.190892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.191140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.191797 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.192204 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.193699 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.202783 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1367/2752] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:13.225541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1386/2753] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:13 2022] POST /identity/v3/projects => generated 383 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:13.229791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.241409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df99fd8d-ba7d-45cb-87d1-2fd9c064dda5 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.278839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.303836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.304702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.304702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.304902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.305532 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.307450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.333307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1368/2754] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:13 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:13.337198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.341870 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8822947-5483-461b-a491-bf50fdb4fd69 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.346008 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.347030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.347691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.348190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.348689 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdca85e-e760-4da7-8fe5-d50d4b2867d3 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.355221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.355872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.356173 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.356432 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.357081 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.358877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.376043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1369/2755] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:13.378030 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.388452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafb7515-8852-4fe9-8d9a-0fa6b68ca7bf admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.393268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.393957 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.394237 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.394510 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] PATH_INFO: `/v3/projects/18dfd496ddc5436687affeb03fee04f8/users/7ff67a29e71f417a8ae3a94c6d6a67bc/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.409881 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] RBAC: Authorizing `identity:create_grant(project_id=18dfd496ddc5436687affeb03fee04f8, user_id=7ff67a29e71f417a8ae3a94c6d6a67bc, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.410876 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.412662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.413067 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.423201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1387/2756] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:13.427942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1370/2757] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:13 2022] PUT /identity/v3/projects/18dfd496ddc5436687affeb03fee04f8/users/7ff67a29e71f417a8ae3a94c6d6a67bc/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:13.431933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.445098 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc724cd1-f665-4d32-b3ef-f056af325309 service cinder] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.477421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:13.510848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.511465 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.511757 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.512044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.512684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.514275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c5ece-e0bb-411c-bdb4-a8340758fcb2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.531919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1388/2758] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:13 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:13.533074 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.546246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401bc5-5c50-467b-88e3-06e7f3ccc45e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.551943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.552807 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.553097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.553365 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] PATH_INFO: `/v3/projects/18dfd496ddc5436687affeb03fee04f8/users/7ff67a29e71f417a8ae3a94c6d6a67bc/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.555426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] RBAC: Authorizing `identity:create_grant(project_id=18dfd496ddc5436687affeb03fee04f8, user_id=7ff67a29e71f417a8ae3a94c6d6a67bc, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.560344 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.571971 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1371/2759] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:13 2022] PUT /identity/v3/projects/18dfd496ddc5436687affeb03fee04f8/users/7ff67a29e71f417a8ae3a94c6d6a67bc/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:13.584308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.584594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.584868 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.615287 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] MFA Rules not processed for user `7ff67a29e71f417a8ae3a94c6d6a67bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:13.616825 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:13.696544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1389/2760] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:13.712492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.712986 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:13.748791 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:13.771259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c832423-e5e3-498b-af9b-f8e1df4f5ed4 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.775035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.775723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.776097 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.776439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.785317 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eed0c2a-269d-4ad2-9a21-5cb24e5d4ecd admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:13.790395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:13.791405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.791775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.792118 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] PATH_INFO: `/v3/users/31c45d25d92c468b85987721e742fb1b` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.793352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=31c45d25d92c468b85987721e742fb1b)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.795815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.839893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:13.841464 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-778698d9-bb6b-4dbb-99f9-585a40d25276 service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:13.848505 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31c45d25d92c468b85987721e742fb1b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:13.849210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31c45d25d92c468b85987721e742fb1b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:13.849836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31c45d25d92c468b85987721e742fb1b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:13.851398 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1390/2761] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:13 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:13.863981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31c45d25d92c468b85987721e742fb1b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:13.870893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31c45d25d92c468b85987721e742fb1b'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:13.889411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1372/2762] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:13 2022] DELETE /identity/v3/users/31c45d25d92c468b85987721e742fb1b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:13.894484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:13.894767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:13.895039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:13.912411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:13.924575 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:13.925794 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:14.006920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1391/2763] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:14.015253 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:14.016969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:14.084011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd8ccf-ddd2-4bdd-80fb-1330399ed9f4 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:14.088895 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:14.089527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:14.089802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:14.090150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:14.100483 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:14.101900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:14.111476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1373/2764] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:14.395075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:14.396646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:14.408486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db80a8ec-0521-411a-80fe-dfab549262f7 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:14.413663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:14.413663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:14.414050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:14.414336 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] PATH_INFO: `/v3/projects/1175af3eea264fa39dccc1685c066b38` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:14.415462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1175af3eea264fa39dccc1685c066b38)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:14.417391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:14.467647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1175af3eea264fa39dccc1685c066b38', 'request_id': 'req-5d4858ad-2af8-4a53-ae4f-064cf736671e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.474854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1175af3eea264fa39dccc1685c066b38', 'request_id': 'req-5d4858ad-2af8-4a53-ae4f-064cf736671e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.481149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1175af3eea264fa39dccc1685c066b38', 'request_id': 'req-5d4858ad-2af8-4a53-ae4f-064cf736671e'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.491331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] The token cache is being invalidate because project 1175af3eea264fa39dccc1685c066b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:14.491614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.492260 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.493715 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1392/2765] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:14 2022] DELETE /identity/v3/projects/1175af3eea264fa39dccc1685c066b38 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:14.497640 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:14.507778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dae34db-23fd-4138-9592-e0a9409d1ef7 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:14.553981 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:14.564547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:14.565702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:14.565978 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:14.566244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] PATH_INFO: `/v3/users/1c49ab127cf04d8b9d8afd7721701f83` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:14.567338 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c49ab127cf04d8b9d8afd7721701f83)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:14.569267 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:14.613463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c49ab127cf04d8b9d8afd7721701f83'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.614024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c49ab127cf04d8b9d8afd7721701f83'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.614617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c49ab127cf04d8b9d8afd7721701f83'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.626116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c49ab127cf04d8b9d8afd7721701f83'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.633623 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-444a401a-50f3-4124-98ce-90d80b710609 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c49ab127cf04d8b9d8afd7721701f83'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:14.646355 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1374/2766] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:14 2022] DELETE /identity/v3/users/1c49ab127cf04d8b9d8afd7721701f83 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:14.915711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:14.917180 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:14.931434 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4858ad-2af8-4a53-ae4f-064cf736671e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:14.987485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:14.988157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:14.988432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:14.988696 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] PATH_INFO: `/v3/projects/2926907151af4351b2fd001b55ae4acf` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:14.989886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=2926907151af4351b2fd001b55ae4acf)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:14.991800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.028907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:15.061188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2926907151af4351b2fd001b55ae4acf', 'request_id': 'req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:15.070286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2926907151af4351b2fd001b55ae4acf', 'request_id': 'req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:15.078209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2926907151af4351b2fd001b55ae4acf', 'request_id': 'req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:15.090019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] The token cache is being invalidate because project 2926907151af4351b2fd001b55ae4acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:15.090394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:15.091940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-a97fee51-5d9c-4522-ae0a-e8c223f5fbaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:15.093427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1393/2767] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:14 2022] DELETE /identity/v3/projects/2926907151af4351b2fd001b55ae4acf => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:15.098068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.098597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.098597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.123580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:15.124462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.192995 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1375/2768] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:15.202655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.203259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.206869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.246495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:15.248655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.262183 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.267285 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1394/2769] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:15.273908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f9f64a-c07d-4105-bc9a-654826ef5e29 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.280808 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.281299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.281577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.281850 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.282494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:15.283236 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.285407 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.304446 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.312066 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1376/2770] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:15.318120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb4aa23-987c-4622-8109-dd4761afb64d None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.327671 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.328483 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.328790 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.329068 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.331429 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.333482 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.377896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1395/2771] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:15 2022] POST /identity/v3/projects => generated 385 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:15.381913 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.392620 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fafea915-b1b0-45af-96e5-9a9b94ed6d8a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.459688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.461829 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.514134 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.516137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.516426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.517305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.519840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.525029 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.535061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:15.550602 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0e656e-5842-414d-9b10-3d246fa9e2da admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.555572 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1377/2772] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:15 2022] POST /identity/v3/users => generated 293 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:15.555833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.556245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.556587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.556987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.559305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.559881 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.569372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bde8fed-420d-45a2-af88-b176b723d9b9 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.574037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.574625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.574918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.575168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.575824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.577414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.591139 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1378/2773] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:15.594855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.605450 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac03569-bb2c-40c9-bc82-519babc4d073 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.610058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.610650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.610927 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.611195 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.611890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.613456 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.623005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.624491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0fa1146-4ad1-4148-ba75-87277a907d5f service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.624617 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1379/2774] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:15 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:15.628748 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.634111 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1396/2775] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:15.638584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e484eeb4-1b47-4abd-971c-d75bb979b39d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.643776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.644458 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.644722 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.644988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] PATH_INFO: `/v3/projects/76f420ad69f04c0aba9545b18282bfb3/users/436af28312f441bc85ba0bff0950e985/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.660310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] RBAC: Authorizing `identity:create_grant(project_id=76f420ad69f04c0aba9545b18282bfb3, user_id=436af28312f441bc85ba0bff0950e985, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.663064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.677256 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1380/2776] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:15 2022] PUT /identity/v3/projects/76f420ad69f04c0aba9545b18282bfb3/users/436af28312f441bc85ba0bff0950e985/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:15.687655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.687977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.688278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.718165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] MFA Rules not processed for user `436af28312f441bc85ba0bff0950e985`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:15.719481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.758262 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:15.794901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1397/2777] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:15.806469 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.808839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:15.868339 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d1f3d-a9b6-4225-8d51-6b9a05c79239 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.872295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.872994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.873341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.873676 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.885133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:15.886687 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1d0619-3c92-491e-a9a3-4fcdc74e958c service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:15.899167 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1381/2778] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:15 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:15.918954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:15.991467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3244e32-cf99-4694-9114-1001d7c508ef None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:15.997625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:15.998131 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:15.998462 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:15.998767 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] PATH_INFO: `/v3/users/436af28312f441bc85ba0bff0950e985` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:15.999878 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=436af28312f441bc85ba0bff0950e985)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.001853 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.059803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436af28312f441bc85ba0bff0950e985'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.060470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436af28312f441bc85ba0bff0950e985'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.061074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436af28312f441bc85ba0bff0950e985'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.069363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436af28312f441bc85ba0bff0950e985'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.084880 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436af28312f441bc85ba0bff0950e985'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.100264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1398/2779] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:15 2022] DELETE /identity/v3/users/436af28312f441bc85ba0bff0950e985 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:16.104937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.105655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.105655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.124301 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:16.125499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.186593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1382/2780] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:16.197030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.198518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.209058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.210630 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.268349 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:INSERT=4,keystone:SELECT=96 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:16.273681 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a200342-7d89-4aca-a740-3eb43d382c77 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.274895 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e074aabd-43ff-451c-b257-bee28e52d8ff admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.278452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.279335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.279641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.279932 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.280210 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.280333 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.280534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.280802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.281977 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.289028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:16.291568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.293040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.311758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1399/2781] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:16.357296 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.358736 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6762e102-3a4e-435c-af94-726504ac5bad service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.369854 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1383/2782] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:16 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:16.598165 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.599634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.615677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec37976-1c06-42cc-bbc6-08d6cbd8da03 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.620300 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.621017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.621230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.621455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] PATH_INFO: `/v3/projects/76f420ad69f04c0aba9545b18282bfb3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.622677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76f420ad69f04c0aba9545b18282bfb3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.624617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.672626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76f420ad69f04c0aba9545b18282bfb3', 'request_id': 'req-d03f8006-a3c5-4a59-b5dc-af2763fb5671'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.679535 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76f420ad69f04c0aba9545b18282bfb3', 'request_id': 'req-d03f8006-a3c5-4a59-b5dc-af2763fb5671'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.685937 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76f420ad69f04c0aba9545b18282bfb3', 'request_id': 'req-d03f8006-a3c5-4a59-b5dc-af2763fb5671'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.698396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] The token cache is being invalidate because project 76f420ad69f04c0aba9545b18282bfb3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:16.698687 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.699338 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d03f8006-a3c5-4a59-b5dc-af2763fb5671 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:16.700861 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1400/2783] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:16 2022] DELETE /identity/v3/projects/76f420ad69f04c0aba9545b18282bfb3 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:16.706584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.706967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.707202 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.726446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:16.727639 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.791789 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1384/2784] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:16.793700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.793981 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.794252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.814076 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:16.815837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:16.823722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1401/2785] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:16.828036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.839112 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2156485-ed52-4d9c-997a-09865236e9d5 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.843901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.844496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.844780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.845028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.845690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:16.845983 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.847559 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.859764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1385/2786] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:16.863781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.873166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0c8cee-f935-4e96-bcc6-b3086ada739a None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.878872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.879054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.879252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.879511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.880439 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.882329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:16.911515 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1402/2787] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:16 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:16.915939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:16.926372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b9efd9-5345-4eae-afe1-71a3a3e6744d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:16.983366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:16.983996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:16.984273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:16.984545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:16.985190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:16.987604 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.013157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1386/2788] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:16 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:17.014394 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.024743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c7a3d4-e122-436b-8245-963f9e0ddcc9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.029382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.029971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.030243 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.030514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.031145 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.032846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.043101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1403/2789] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:17.046937 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.057439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385e1873-6d74-4e80-a8c4-faba45dde5ce admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.062457 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.063056 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.063333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.063603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.064280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.066459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27babc5-cb04-429a-8a83-16d13204bbe3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.077082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1387/2790] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:17.081284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.091036 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3fe836-e9ea-461b-b2a2-11734d015f55 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.095518 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.096229 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.096507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.096773 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] PATH_INFO: `/v3/projects/ce8ea5fb04c049478b5c3c47d114fc3e/users/047aa536765e4dfea11d861a9e4a4d26/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.110758 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce8ea5fb04c049478b5c3c47d114fc3e, user_id=047aa536765e4dfea11d861a9e4a4d26, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.113938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.126494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1404/2791] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:17 2022] PUT /identity/v3/projects/ce8ea5fb04c049478b5c3c47d114fc3e/users/047aa536765e4dfea11d861a9e4a4d26/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:17.137987 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.138491 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.138589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.145718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:17.167871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] MFA Rules not processed for user `047aa536765e4dfea11d861a9e4a4d26`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:17.169119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:17.236148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1388/2792] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:17.241251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.305491 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e52bac9-e59f-4774-9fc5-ffb0d1692929 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.310044 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.310640 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.310924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.311182 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.311834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.313732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.337045 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:17.344170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1405/2793] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/projects => generated 377 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:17.348098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.359558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793615eb-5047-4597-ac23-5f2a69799289 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.422751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.423400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.423675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.424627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.425260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.427270 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.459546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1389/2794] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/users => generated 289 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:17.462410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.473930 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f2f9c-630e-4fca-899d-a5c74f1cb6ef admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.478884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.479589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.479856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.480128 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.480765 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.482498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.495018 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1406/2795] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:17.499391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.515692 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dcf2f3-9326-4a22-a3e0-900394bf0de8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.528373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.528950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.529224 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.530241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.530241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.531710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561aec61-154c-4d66-80f1-3a1ea04c3bb1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.544072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1390/2796] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:17.548080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.560752 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c535acb-8f59-43a8-b6ec-f86aa5d5f4a5 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.568166 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.568833 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.569149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.569417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] PATH_INFO: `/v3/projects/5e53a59340bd440f8c8d086d27855805/users/999b8bacc4a0479db5c5202a8e57f19f/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.591410 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5e53a59340bd440f8c8d086d27855805, user_id=999b8bacc4a0479db5c5202a8e57f19f, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.595106 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.614345 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1407/2797] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:17 2022] PUT /identity/v3/projects/5e53a59340bd440f8c8d086d27855805/users/999b8bacc4a0479db5c5202a8e57f19f/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:17.625521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.625815 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.626113 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.657041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] MFA Rules not processed for user `999b8bacc4a0479db5c5202a8e57f19f`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:17.658282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:17.746528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:17.751912 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1391/2798] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:17.755481 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.829376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a946653e-6c7b-46e6-9d22-98486a9e9fd6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.838286 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.839000 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.839284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.839643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.840328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.842267 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.870335 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1408/2799] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:17.874575 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.886221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27d938b-16c9-4b77-9786-622f9c04ee32 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.941785 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.942377 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.942650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.942919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.943547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.945459 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.966168 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1392/2800] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:17 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:17.970236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:17.980996 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25a7198-07ca-4abb-9f1f-39d69f277517 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:17.985588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:17.986181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:17.986461 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:17.986734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:17.987368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:17.989014 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:17.999393 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1409/2801] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:18.003324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:18.013430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7a7a9a-57ad-4ff4-a7ce-5b5a863d72f0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:18.019492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:18.020282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:18.020562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:18.020838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] PATH_INFO: `/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f/users/7def08ccf5b745a1a0ce8c24a8d42c4a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:18.035664 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed3dbf55564dc3acbcb5cc92a2711f, user_id=7def08ccf5b745a1a0ce8c24a8d42c4a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:18.038330 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:18.051214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1393/2802] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:18 2022] PUT /identity/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f/users/7def08ccf5b745a1a0ce8c24a8d42c4a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:18.055140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:18.065118 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3d76cd-b3f9-4fab-b61e-bc112cff64bb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:18.121190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:18.121800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:18.122079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:18.122348 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:18.122975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:18.124655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f05a6c9-fc6f-480d-a68a-88126506101d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:18.135400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1410/2803] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:18 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:18.139541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:18.150548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e528b0-e9b1-43a9-9fe8-d8dbb5f53d47 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:18.155065 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:18.155705 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:18.156006 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:18.156275 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] PATH_INFO: `/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f/users/7def08ccf5b745a1a0ce8c24a8d42c4a/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:18.158159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eaed3dbf55564dc3acbcb5cc92a2711f, user_id=7def08ccf5b745a1a0ce8c24a8d42c4a, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:18.160787 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:18.170541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1394/2804] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:18 2022] PUT /identity/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f/users/7def08ccf5b745a1a0ce8c24a8d42c4a/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:18.180353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:18.180652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:18.180919 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:18.208452 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] MFA Rules not processed for user `7def08ccf5b745a1a0ce8c24a8d42c4a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:18.209647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:18.233947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:18.280921 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1411/2805] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:18 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:18.292385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:18.294103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:18.350697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52525a14-b88a-4ff8-8775-10dbbc336af0 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:18.354368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:18.355010 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:18.355289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:18.355564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:18.411847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:18.413274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:18.422011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1395/2806] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:18 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:19.879154 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:19.880949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:19.923072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:19.932326 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb17328f-8602-4d2b-996b-25fa699bc88a service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:19.935945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:19.936548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:19.936824 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:19.937100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:19.939261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff172df9-99f5-493a-a1f0-e59499268d28 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:19.941832 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:19.943337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:19.944043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:19.944391 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:19.944677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:19.946573 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:19.996034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:19.997400 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:20.007172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1396/2807] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:20.020148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:20.021648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:20.032619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1412/2808] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:20.514008 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:20.517324 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:20.591463 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624e9da3-6392-41e8-85f1-eb88ff0d8f39 service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:20.600391 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:20.601133 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:20.601451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:20.601871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] PATH_INFO: `/v3/users/9e0c0f95071448dcab8463099514bed2` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:20.602943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e0c0f95071448dcab8463099514bed2)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:20.604897 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:20.607839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:20.618054 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8345100c-8e68-4c49-9084-bffdc0ea9315 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:20.621628 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:20.622230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:20.622512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:20.622781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:20.632204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:20.633872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e10f84-5070-4467-8518-87bf8cb48c1c service cinder] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:20.643837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1413/2809] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:20.653439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e0c0f95071448dcab8463099514bed2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:20.654111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e0c0f95071448dcab8463099514bed2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:20.654718 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e0c0f95071448dcab8463099514bed2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:20.667273 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e0c0f95071448dcab8463099514bed2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:20.675132 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e0c0f95071448dcab8463099514bed2'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:20.688759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1397/2810] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:20 2022] DELETE /identity/v3/users/9e0c0f95071448dcab8463099514bed2 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:20.693343 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:20.693639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:20.693960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:20.715061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:20.716486 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:20.760490 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:20.776883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1414/2811] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:20.787152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:20.788589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:20.817549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:20.849308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6814cb-92d6-4e4a-827d-1fa193e5ed22 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:20.852930 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:20.853530 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:20.853839 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:20.854109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:20.863517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:20.865021 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:20.874759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1398/2812] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:21.165408 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:21.166877 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:21.178899 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5145c-27dc-4bc2-a8b7-44e60a8dafda None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:21.183632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:21.184314 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:21.184588 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:21.184856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] PATH_INFO: `/v3/projects/47a3bd1278e549ab9350839d65f8e553` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:21.186007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a3bd1278e549ab9350839d65f8e553)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:21.187939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:21.236474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a3bd1278e549ab9350839d65f8e553', 'request_id': 'req-f8f7d580-ef06-491d-a695-6502c752c8eb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.243867 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a3bd1278e549ab9350839d65f8e553', 'request_id': 'req-f8f7d580-ef06-491d-a695-6502c752c8eb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.250247 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a3bd1278e549ab9350839d65f8e553', 'request_id': 'req-f8f7d580-ef06-491d-a695-6502c752c8eb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.261294 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] The token cache is being invalidate because project 47a3bd1278e549ab9350839d65f8e553 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:21.261577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.262206 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.263691 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1415/2813] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:21 2022] DELETE /identity/v3/projects/47a3bd1278e549ab9350839d65f8e553 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:21.268347 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:21.277950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0cf571-ba88-4c22-bddc-fc43ea22e760 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:21.332403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:21.333032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:21.333309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:21.333581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] PATH_INFO: `/v3/users/3e213b2b82ab47d586a917969b16df03` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:21.334699 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e213b2b82ab47d586a917969b16df03)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:21.336661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:21.381652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e213b2b82ab47d586a917969b16df03'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.382287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e213b2b82ab47d586a917969b16df03'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.382896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e213b2b82ab47d586a917969b16df03'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.395130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e213b2b82ab47d586a917969b16df03'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.401916 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e213b2b82ab47d586a917969b16df03'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.413898 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1399/2814] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:21 2022] DELETE /identity/v3/users/3e213b2b82ab47d586a917969b16df03 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:21.693949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:21.695459 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:21.711279 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7d580-ef06-491d-a695-6502c752c8eb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:21.775242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:21.775958 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:21.776221 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:21.783970 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] PATH_INFO: `/v3/projects/e8df675c0aff45aeb1c9ac0117d742c8` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:21.785264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8df675c0aff45aeb1c9ac0117d742c8)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:21.787240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:21.851942 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8df675c0aff45aeb1c9ac0117d742c8', 'request_id': 'req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.856366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8df675c0aff45aeb1c9ac0117d742c8', 'request_id': 'req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.863424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8df675c0aff45aeb1c9ac0117d742c8', 'request_id': 'req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.869135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:21.871387 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:21.875460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] The token cache is being invalidate because project e8df675c0aff45aeb1c9ac0117d742c8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:21.875806 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.876796 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:21.882655 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1416/2815] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:21 2022] DELETE /identity/v3/projects/e8df675c0aff45aeb1c9ac0117d742c8 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:21.883639 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:21.885144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:21.892384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:21.940193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:21.945892 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bebebf-f702-40fa-8074-9380b3f64bc7 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:21.964297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383a1038-cdd8-4a9b-bafc-f48a98e1ba53 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:21.969384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:21.970115 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:21.971310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:21.971310 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] PATH_INFO: `/v3/users/7ff67a29e71f417a8ae3a94c6d6a67bc` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:21.972545 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ff67a29e71f417a8ae3a94c6d6a67bc)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:21.974563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.015935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.016509 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.017061 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.017193 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.019367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:22.042424 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ff67a29e71f417a8ae3a94c6d6a67bc'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.042637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ff67a29e71f417a8ae3a94c6d6a67bc'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.043323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ff67a29e71f417a8ae3a94c6d6a67bc'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.052520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ff67a29e71f417a8ae3a94c6d6a67bc'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.074257 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ff67a29e71f417a8ae3a94c6d6a67bc'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.089492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1417/2816] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:21 2022] DELETE /identity/v3/users/7ff67a29e71f417a8ae3a94c6d6a67bc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:22.122840 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.124636 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c910d6-4b03-4848-a5ae-6d4f90cae060 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.135764 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1400/2817] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:22.386939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.388435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:22.462209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f313af-c74b-44d5-a650-ede517157d8d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.467436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.468186 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.468496 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.468775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] PATH_INFO: `/v3/projects/18dfd496ddc5436687affeb03fee04f8` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.469914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18dfd496ddc5436687affeb03fee04f8)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.472534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.498372 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:22.526157 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18dfd496ddc5436687affeb03fee04f8', 'request_id': 'req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.535170 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18dfd496ddc5436687affeb03fee04f8', 'request_id': 'req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.542151 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18dfd496ddc5436687affeb03fee04f8', 'request_id': 'req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.553065 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] The token cache is being invalidate because project 18dfd496ddc5436687affeb03fee04f8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:22.553403 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.554029 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-699c4d4c-d0c9-4398-a6d8-0fd6d0e235d1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:22.555528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1418/2818] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:22 2022] DELETE /identity/v3/projects/18dfd496ddc5436687affeb03fee04f8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:22.560666 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.561154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.561240 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.581702 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:22.582893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:22.645607 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1401/2819] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:22.653862 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.654143 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.654414 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.674201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:22.675384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:22.683319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1419/2820] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:22.687585 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.698287 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5f5373-ec5b-4f3d-8ff7-6cfa2eece65d None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.703036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.703633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.703931 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.704203 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.704844 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:22.705796 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.707390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.719580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1402/2821] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:22.724497 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.737485 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1b56cb-72c6-4faf-8110-84ba0a4ba3f1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.744236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.745198 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.745747 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.746027 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.746901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.748918 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.785047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1420/2822] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:22 2022] POST /identity/v3/projects => generated 381 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:22.786363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.796580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358f512-dd38-4f11-a35f-a42193e115d1 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.835888 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:22.854964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.855574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.855883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.856159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.856797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.858694 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.880154 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1403/2823] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:22 2022] POST /identity/v3/users => generated 291 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:22.884576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.895651 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28a4acc-90f8-4e6b-8ce5-bcfaa0cd3c43 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.900802 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.901480 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.901844 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.902185 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.902897 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.904778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.919357 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1421/2824] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:22.920826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.931180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d90456-86fa-43ba-8468-797a4a1823a6 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.935812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.936410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.936686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.936956 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.937619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.939200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6802c2-0429-4701-80fd-3d5a7f7d8c19 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:22.951057 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1404/2825] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:22.956177 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:22.966225 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004c554-7b5d-4825-a707-4398fe3e778e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:22.970927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:22.971586 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:22.971939 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:22.972179 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] PATH_INFO: `/v3/projects/a243c50cd9744b96b39e4835e4a4f8b5/users/af3994f5477a4a2392607ee59ae684a8/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:22.987506 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] RBAC: Authorizing `identity:create_grant(project_id=a243c50cd9744b96b39e4835e4a4f8b5, user_id=af3994f5477a4a2392607ee59ae684a8, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:22.990332 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:23.004302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1422/2826] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:22 2022] PUT /identity/v3/projects/a243c50cd9744b96b39e4835e4a4f8b5/users/af3994f5477a4a2392607ee59ae684a8/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:23.009743 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:23.010024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:23.010452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:23.030385 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:23.031591 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:23.093078 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1405/2827] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:23.104074 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:23.105815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:23.171353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc009f17-6e37-469b-8d4a-322a62459ffb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:23.175554 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:23.176189 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:23.176469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:23.176739 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:23.187248 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:23.188603 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:23.198716 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1423/2828] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:24.148254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:24.150919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:24.166155 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-632a7c8f-6e0f-4f59-8288-b5f1358747f1 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:24.171974 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:24.173467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:24.173965 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:24.174426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:24.176697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:24.253143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:24.255164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38d8628-7a20-48c8-a40e-231701caf792 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:24.269527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1406/2829] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:24 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:24.594087 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:24.596411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:24.610328 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bb123c5-1fc1-416d-bc58-fb0887988e7d service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:24.616050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:24.617945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:24.617945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:24.617945 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] PATH_INFO: `/v3/users/047aa536765e4dfea11d861a9e4a4d26` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:24.618581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] RBAC: Authorizing `identity:delete_user(user_id=047aa536765e4dfea11d861a9e4a4d26)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:24.623242 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:24.694839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=84,keystone:DELETE=13,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:24.697158 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '047aa536765e4dfea11d861a9e4a4d26'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:24.697954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '047aa536765e4dfea11d861a9e4a4d26'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:24.698775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '047aa536765e4dfea11d861a9e4a4d26'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:24.714645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '047aa536765e4dfea11d861a9e4a4d26'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:24.731239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '047aa536765e4dfea11d861a9e4a4d26'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:24.750869 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1424/2830] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:24 2022] DELETE /identity/v3/users/047aa536765e4dfea11d861a9e4a4d26 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:24.752869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:24.753157 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:24.753435 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:24.775082 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:24.776452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:24.827533 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:24.883827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1407/2831] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:24.897254 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:24.898735 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:24.982043 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5039c575-dfbb-446e-b607-56b8928ab49e admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:25.000172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:25.001178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:25.001311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:25.001587 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:25.015201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:25.016705 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:25.027669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1425/2832] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:25.311514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:25.313162 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:25.326790 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c8d99-b17b-4df4-89e7-22e697fe6429 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:25.334859 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:25.335923 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:25.336380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:25.337123 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] PATH_INFO: `/v3/projects/ce8ea5fb04c049478b5c3c47d114fc3e` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:25.343843 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce8ea5fb04c049478b5c3c47d114fc3e)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:25.347797 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:25.418473 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce8ea5fb04c049478b5c3c47d114fc3e', 'request_id': 'req-cab1d861-d81b-489c-8f63-3dd405b69558'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.435786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce8ea5fb04c049478b5c3c47d114fc3e', 'request_id': 'req-cab1d861-d81b-489c-8f63-3dd405b69558'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.452174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce8ea5fb04c049478b5c3c47d114fc3e', 'request_id': 'req-cab1d861-d81b-489c-8f63-3dd405b69558'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.477871 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] The token cache is being invalidate because project ce8ea5fb04c049478b5c3c47d114fc3e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:25.478546 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.479499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.481713 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1408/2833] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:25 2022] DELETE /identity/v3/projects/ce8ea5fb04c049478b5c3c47d114fc3e => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:25.485645 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:25.500448 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec2444-60eb-4362-b09e-50e1c755536f service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:25.573563 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:25.574374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:25.574743 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:25.575108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] PATH_INFO: `/v3/users/999b8bacc4a0479db5c5202a8e57f19f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:25.576421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999b8bacc4a0479db5c5202a8e57f19f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:25.578470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:25.639116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999b8bacc4a0479db5c5202a8e57f19f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.640239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999b8bacc4a0479db5c5202a8e57f19f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.640940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999b8bacc4a0479db5c5202a8e57f19f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.649470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999b8bacc4a0479db5c5202a8e57f19f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.658763 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:25.664622 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999b8bacc4a0479db5c5202a8e57f19f'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:25.681047 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1426/2834] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:25 2022] DELETE /identity/v3/users/999b8bacc4a0479db5c5202a8e57f19f => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:26.122499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:26.124011 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:26.148468 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab1d861-d81b-489c-8f63-3dd405b69558 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:26.269185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:26.273462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:26.274906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:26.275595 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] PATH_INFO: `/v3/projects/5e53a59340bd440f8c8d086d27855805` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:26.277150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5e53a59340bd440f8c8d086d27855805)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:26.282652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:26.396092 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5e53a59340bd440f8c8d086d27855805', 'request_id': 'req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.412381 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5e53a59340bd440f8c8d086d27855805', 'request_id': 'req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.425098 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5e53a59340bd440f8c8d086d27855805', 'request_id': 'req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.456698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:26.466423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] The token cache is being invalidate because project 5e53a59340bd440f8c8d086d27855805 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:26.467059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.468020 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.474214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1409/2835] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:26 2022] DELETE /identity/v3/projects/5e53a59340bd440f8c8d086d27855805 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:26.478253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:26.480046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:26.500085 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49886cd7-9ff3-49b5-b6e9-30f435c6e3e1 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:26.637824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:26.637824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:26.637824 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:26.638122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] PATH_INFO: `/v3/users/7def08ccf5b745a1a0ce8c24a8d42c4a` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:26.639209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] RBAC: Authorizing `identity:delete_user(user_id=7def08ccf5b745a1a0ce8c24a8d42c4a)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:26.642023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:26.715617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7def08ccf5b745a1a0ce8c24a8d42c4a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.716647 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7def08ccf5b745a1a0ce8c24a8d42c4a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.717467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7def08ccf5b745a1a0ce8c24a8d42c4a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.726688 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7def08ccf5b745a1a0ce8c24a8d42c4a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.741030 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0e7b35d-de8d-46ac-8997-33ca019be50a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7def08ccf5b745a1a0ce8c24a8d42c4a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:26.762134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1427/2836] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:26 2022] DELETE /identity/v3/users/7def08ccf5b745a1a0ce8c24a8d42c4a => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:27.130492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.132125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:27.154444 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08c1e70-47e3-45bf-ae5e-86bce7d902a8 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.233896 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.234611 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.234919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.235198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] PATH_INFO: `/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.237150 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=eaed3dbf55564dc3acbcb5cc92a2711f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.239170 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.296846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eaed3dbf55564dc3acbcb5cc92a2711f', 'request_id': 'req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:27.311939 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eaed3dbf55564dc3acbcb5cc92a2711f', 'request_id': 'req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:27.320390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eaed3dbf55564dc3acbcb5cc92a2711f', 'request_id': 'req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:27.350174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] The token cache is being invalidate because project eaed3dbf55564dc3acbcb5cc92a2711f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:27.350299 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:27.362198 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-630d2658-1dfc-4d81-83fb-0f6d7f63a0ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:27.366855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1410/2837] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:27 2022] DELETE /identity/v3/projects/eaed3dbf55564dc3acbcb5cc92a2711f => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:27.371810 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.372084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.372367 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.407526 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:27.409365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:27.496889 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1428/2838] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:27.500102 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.500915 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.501354 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.547180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:27.548442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:27.556821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1411/2839] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:27.561304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.568519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:27.573075 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e533bb-f219-47fd-b73d-31c2ae44b778 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.582278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.583040 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.583662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.584239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] PATH_INFO: `/v3/domains` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.585006 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87788) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:27.585382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.587090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.601236 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1429/2840] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:27.605573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.615159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d5f6e-58d0-4558-ac2b-962f83a00511 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.620180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.621032 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.621605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.622172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.623068 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.625282 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.672919 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1412/2841] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:27 2022] POST /identity/v3/projects => generated 373 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:27.677353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.693033 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee546f4-a8d2-4983-ba08-09fb1ad507a9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.781831 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.785907 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.786197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.786476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.787130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.789156 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.819023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1430/2842] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:27 2022] POST /identity/v3/users => generated 287 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:27.820025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.833408 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778084b-c2bb-4614-b989-b9b11de3d761 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.840811 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.842667 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.843017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.843357 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.844156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.846574 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.858437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1413/2843] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:27.862358 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.873510 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500622ff-eadc-4e66-bf32-47a166b0a5e8 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.879494 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.880495 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.880906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.881079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.881723 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.883376 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c47ff9a-cfab-4bdf-a4fe-3703cbef218a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.896871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1431/2844] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:27 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:27.901390 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:27.913821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872c425-b14d-466e-a513-b7915d0e6969 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:27.932069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:27.932069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.932069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.932069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] PATH_INFO: `/v3/projects/eb27f70f1e564d178391319b7769d77f/users/b0470fab520f434e9848c9852ba10aca/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:27.954991 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb27f70f1e564d178391319b7769d77f, user_id=b0470fab520f434e9848c9852ba10aca, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:27.958321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:27.979803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1414/2845] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:27 2022] PUT /identity/v3/projects/eb27f70f1e564d178391319b7769d77f/users/b0470fab520f434e9848c9852ba10aca/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:27.994405 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587468f-9219-457d-bd78-7759e31d0101 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:27.994707 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587468f-9219-457d-bd78-7759e31d0101 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:27.994968 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3587468f-9219-457d-bd78-7759e31d0101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.042698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-3587468f-9219-457d-bd78-7759e31d0101 None None] MFA Rules not processed for user `b0470fab520f434e9848c9852ba10aca`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:28.044109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-3587468f-9219-457d-bd78-7759e31d0101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:28.173069 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1432/2846] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:28.189436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.191625 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:28.251169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:28.316531 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde3a200-6bc3-4d20-bbde-e7eca1dada92 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.321209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.322675 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.323116 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.323576 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.341969 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.343552 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.346957 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.347231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.347499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.364395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1415/2847] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:28.393795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] MFA Rules not processed for user `af3994f5477a4a2392607ee59ae684a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:28.395282 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:28.469884 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:28.498808 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1433/2848] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:28 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:28.499423 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.500860 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:28.584657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a878ea6-b264-4c59-81c6-11d4eacdaa0f service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.590847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.591867 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.592405 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.592933 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.593863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.596775 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.627891 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1416/2849] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:28 2022] POST /identity/v3/projects => generated 385 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:28.632928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.645469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6efcfa-2d96-4208-932b-1ef841a93985 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.737340 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.738102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.738544 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.738951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] PATH_INFO: `/v3/users` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.739657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.741756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.770281 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1434/2850] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:28 2022] POST /identity/v3/users => generated 299 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:28.771426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.782959 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191026b1-c6b7-43e4-be60-a5948f0856a5 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.787890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.788490 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.788778 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.789043 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.789697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.791388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.802855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1417/2851] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:28.807341 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.817734 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f5f6fa-8850-40e3-b2c3-eb9ec5f03fe9 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.822308 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.822979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.823253 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.823521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] PATH_INFO: `/v3/projects/58041930da9a453f8b30313ad0b7b31c/users/fb5dd335d94b4fae86d3b62c83f036bc/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.838576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] RBAC: Authorizing `identity:create_grant(project_id=58041930da9a453f8b30313ad0b7b31c, user_id=fb5dd335d94b4fae86d3b62c83f036bc, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.841252 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.855204 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1435/2852] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:28 2022] PUT /identity/v3/projects/58041930da9a453f8b30313ad0b7b31c/users/fb5dd335d94b4fae86d3b62c83f036bc/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:28.859100 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.869159 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b52343-2075-42ee-be63-7f1ab0afec17 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.925671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.926284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.926564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.926836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.927475 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.929110 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6de97a-4366-4a5b-9202-087c35cd9ad3 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.938802 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1418/2853] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:28.943417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:28.953693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63016e18-4707-497e-92b2-965bb615150d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:28.958973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:28.959617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:28.959931 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:28.960209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] PATH_INFO: `/v3/projects/58041930da9a453f8b30313ad0b7b31c/users/fb5dd335d94b4fae86d3b62c83f036bc/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:28.962127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] RBAC: Authorizing `identity:create_grant(project_id=58041930da9a453f8b30313ad0b7b31c, user_id=fb5dd335d94b4fae86d3b62c83f036bc, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:28.965718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487b1667-2c63-4566-94a0-324e015e004b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:28.976849 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1436/2854] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:28 2022] PUT /identity/v3/projects/58041930da9a453f8b30313ad0b7b31c/users/fb5dd335d94b4fae86d3b62c83f036bc/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:29.909380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:29.911034 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:29.911318 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:29.934109 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] MFA Rules not processed for user `b0470fab520f434e9848c9852ba10aca`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:29.936380 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:29.983166 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:30.012911 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1419/2855] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:29 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:34.465566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53cb7-ab55-4f93-9de4-346db3ae70ba None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:34.466389 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53cb7-ab55-4f93-9de4-346db3ae70ba None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:34.466840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f53cb7-ab55-4f93-9de4-346db3ae70ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:34.515099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-a0f53cb7-ab55-4f93-9de4-346db3ae70ba None None] MFA Rules not processed for user `fb5dd335d94b4fae86d3b62c83f036bc`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:34.516641 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a0f53cb7-ab55-4f93-9de4-346db3ae70ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:34.650997 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1437/2856] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:34 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:34.658404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:34.660187 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:34.729771 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-710b8b82-6490-4827-b7c3-d155cfdeafaa None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:34.733379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c71d74618fe94bddab05e457aaab72ff', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:34.734001 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:34.734277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:34.734548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:34.798631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:34.800190 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:34.810410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1420/2857] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:34 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:34.995650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:34.996052 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:34.996331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:35.046329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:35.059574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:35.061102 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:35.143509 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1438/2858] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:02:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:35.202290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:35.203963 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:35.327135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c18bad-3dff-436d-957c-848757c682b4 service glance] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:35.333025 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:35.333631 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:35.334059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:35.334333 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:35.343024 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:35.345107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:35.355513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1421/2859] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:02:36.291466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:36.295578 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:36.373725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a92645-e1f4-4658-b3a9-20746fcea157 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:36.379007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:36.380136 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:36.380574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:36.381002 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:36.383082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:36.397532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:36.400144 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:36.411368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1439/2860] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:36 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:44.195045 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:44.196069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:44.216922 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:44.313603 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1144c250-a534-4ae8-a136-9ce38e9a5f4a service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:44.330307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:44.330988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:44.331268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:44.331545 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] PATH_INFO: `/v3/users/ee4897153ad74277a3dd447ebd767e9f` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:44.334955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee4897153ad74277a3dd447ebd767e9f)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:44.337119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:44.405715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee4897153ad74277a3dd447ebd767e9f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.406584 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee4897153ad74277a3dd447ebd767e9f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.407482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee4897153ad74277a3dd447ebd767e9f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.433199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee4897153ad74277a3dd447ebd767e9f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.445564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee4897153ad74277a3dd447ebd767e9f'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.466781 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1422/2861] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:44 2022] DELETE /identity/v3/users/ee4897153ad74277a3dd447ebd767e9f => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:44.657571 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:44.671466 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93945d2b-62a7-44de-a292-2b242658145a service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:44.738419 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:44.739216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:44.739800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:44.739946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] PATH_INFO: `/v3/projects/66857150ee7444cd8e928ad950a7e02b` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:44.741103 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] RBAC: Authorizing `identity:delete_project(project_id=66857150ee7444cd8e928ad950a7e02b)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:44.743079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:44.800331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:44.805219 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '66857150ee7444cd8e928ad950a7e02b', 'request_id': 'req-488c1de7-1d00-49c8-b25b-f69822bd24cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.816197 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '66857150ee7444cd8e928ad950a7e02b', 'request_id': 'req-488c1de7-1d00-49c8-b25b-f69822bd24cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.823667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '66857150ee7444cd8e928ad950a7e02b', 'request_id': 'req-488c1de7-1d00-49c8-b25b-f69822bd24cb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.837334 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] The token cache is being invalidate because project 66857150ee7444cd8e928ad950a7e02b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:44.837632 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.838312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.839872 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1440/2862] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:44 2022] DELETE /identity/v3/projects/66857150ee7444cd8e928ad950a7e02b => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:44.844151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:44.847670 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:44.861809 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655acf61-d9d3-409d-b0fa-065111e18e84 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:44.933368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:44.934036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:44.934313 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:44.934589 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] PATH_INFO: `/v3/users/6727eb13eebc4e4cb5aa65b7bf7391a5` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:44.935946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6727eb13eebc4e4cb5aa65b7bf7391a5)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:44.938231 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:44.976746 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:44.999041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6727eb13eebc4e4cb5aa65b7bf7391a5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:44.999710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6727eb13eebc4e4cb5aa65b7bf7391a5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.000608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6727eb13eebc4e4cb5aa65b7bf7391a5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.020556 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6727eb13eebc4e4cb5aa65b7bf7391a5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.028635 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ecebb710-1485-49e4-bec4-e091ac86af31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6727eb13eebc4e4cb5aa65b7bf7391a5'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.044994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1423/2863] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:44 2022] DELETE /identity/v3/users/6727eb13eebc4e4cb5aa65b7bf7391a5 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:45.242626 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.244178 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:45.272079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-488c1de7-1d00-49c8-b25b-f69822bd24cb admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.332650 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.333658 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.334148 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.334635 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] PATH_INFO: `/v3/projects/0eff43f752dd43498140be9596278097` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.335873 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eff43f752dd43498140be9596278097)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.337850 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.386605 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eff43f752dd43498140be9596278097', 'request_id': 'req-26a951f5-b02a-4a91-966f-7e56adaf2eeb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.395677 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eff43f752dd43498140be9596278097', 'request_id': 'req-26a951f5-b02a-4a91-966f-7e56adaf2eeb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.403451 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eff43f752dd43498140be9596278097', 'request_id': 'req-26a951f5-b02a-4a91-966f-7e56adaf2eeb'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.418804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] The token cache is being invalidate because project 0eff43f752dd43498140be9596278097 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:45.419159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.419854 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-26a951f5-b02a-4a91-966f-7e56adaf2eeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:45.421678 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1441/2864] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:45 2022] DELETE /identity/v3/projects/0eff43f752dd43498140be9596278097 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:45.427535 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.428093 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.428207 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.452462 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:45.453661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:45.530044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1424/2865] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:45.531800 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a62a6-67a5-4d94-91f5-b601bac996b9 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.532093 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a62a6-67a5-4d94-91f5-b601bac996b9 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.532441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-016a62a6-67a5-4d94-91f5-b601bac996b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.569813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-016a62a6-67a5-4d94-91f5-b601bac996b9 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:45.571313 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-016a62a6-67a5-4d94-91f5-b601bac996b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:45.583498 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1442/2866] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:45.584654 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.596988 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453f3b3e-a15c-4fcc-bc03-f24e0596022f None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.613519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.614363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.614725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.615119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.615885 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:45.616261 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.618285 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.620392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.620711 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.621227 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.633265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1425/2867] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:45.637566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.644071 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] MFA Rules not processed for user `af3994f5477a4a2392607ee59ae684a8`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:45.645264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:45.648084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4d52d7-faec-42ec-b381-894cbf0273da admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.653353 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.653955 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.654352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.654513 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] PATH_INFO: `/v3/projects` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.655125 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.657172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.689494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1426/2868] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:45.697328 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.700965 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:45.710278 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1443/2869] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:45.763342 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e92e4a-b0c7-4db4-aa16-e30eb0932a6f admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.768684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.769289 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.769579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.769846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.770472 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.772427 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.789855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:45.796184 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1427/2870] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:45.800315 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.810975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2ec90a-02d4-44cc-acd8-18c8d7156985 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.815512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.816153 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.816425 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.816788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.817450 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.819035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.830171 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1444/2871] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:45.834143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.844241 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad129bbd-9b90-462e-ba92-87e0bdbcb81a admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.856148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.856773 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.857049 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.857322 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.857964 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.859710 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88af29a5-8ff1-44a4-a05c-b30509c7c306 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.876052 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1428/2872] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:45.880974 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.891230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e8da57-b093-41da-b544-1aa70d413af2 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:45.896693 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:45.897349 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.897623 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.897920 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] PATH_INFO: `/v3/projects/0037aca1a5ff4640881ba886887b282b/users/fc77623caa5449c5bb4541a03e6ab0e3/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.915606 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0037aca1a5ff4640881ba886887b282b, user_id=fc77623caa5449c5bb4541a03e6ab0e3, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:45.918342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:45.932999 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1445/2873] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:45 2022] PUT /identity/v3/projects/0037aca1a5ff4640881ba886887b282b/users/fc77623caa5449c5bb4541a03e6ab0e3/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:45.945191 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:45.945471 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:45.945770 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:45.978037 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] MFA Rules not processed for user `fc77623caa5449c5bb4541a03e6ab0e3`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:45.979494 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:45.981215 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:45.983293 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.049673 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a250e9-a402-4465-8b6c-c61975804aa3 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:46.053839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:46.054444 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.054719 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.054985 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.056254 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1429/2874] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:45 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:46.056778 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.069044 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:46.071107 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.074983 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:46.076455 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:46.085528 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1446/2875] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:45 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:46.134115 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239a331-93ef-46a6-911b-f1fa5ee9e657 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:46.137992 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:46.138599 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.138989 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.139268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.149633 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:46.151290 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdacd0f-baa9-4bff-89a9-c5cf42a249a2 service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:46.160460 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1430/2876] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:46.184058 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:46.259025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33868e5-ca19-4ea3-855c-df68133e655d service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:46.264589 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:46.265329 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.266007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.266007 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] PATH_INFO: `/v3/users/fc77623caa5449c5bb4541a03e6ab0e3` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.267200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc77623caa5449c5bb4541a03e6ab0e3)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:46.269264 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:46.349998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc77623caa5449c5bb4541a03e6ab0e3'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:46.350684 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc77623caa5449c5bb4541a03e6ab0e3'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:46.351593 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc77623caa5449c5bb4541a03e6ab0e3'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:46.366467 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc77623caa5449c5bb4541a03e6ab0e3'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:46.394119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:46.410858 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc77623caa5449c5bb4541a03e6ab0e3'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:46.428520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1447/2877] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:46 2022] DELETE /identity/v3/users/fc77623caa5449c5bb4541a03e6ab0e3 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:46.433967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.435521 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.435852 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.485723 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:46.487563 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.535251 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:46.537857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.582580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1431/2878] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:46.592940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:46.596368 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.626245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:46.638023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96bd171d-c1c6-49f8-99ac-e345e4ad0b23 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:46.644042 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:46.644574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.644848 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.645116 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.646840 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:46.661269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:46.663051 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:46.663648 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d382af-6ae5-4185-b602-71463ebff926 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:46.667200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:46.667833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:46.668111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:46.669130 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:46.673322 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1448/2879] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:46 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:46.677890 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:46.679294 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59036749-f787-46a0-9f66-fbc900e5a1a6 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:46.689426 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1432/2880] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:02:47.040003 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.041512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:47.058417 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7566d4bc-f262-483f-8daf-d0fbf0457c53 service placement] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.064710 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.065928 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.066400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.066933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] PATH_INFO: `/v3/projects/0037aca1a5ff4640881ba886887b282b` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.068594 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] RBAC: Authorizing `identity:delete_project(project_id=0037aca1a5ff4640881ba886887b282b)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.071046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.122331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0037aca1a5ff4640881ba886887b282b', 'request_id': 'req-959d58f0-602d-44f7-a079-a17ec61c202a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:47.130667 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0037aca1a5ff4640881ba886887b282b', 'request_id': 'req-959d58f0-602d-44f7-a079-a17ec61c202a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:47.137004 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0037aca1a5ff4640881ba886887b282b', 'request_id': 'req-959d58f0-602d-44f7-a079-a17ec61c202a'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:47.147311 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] The token cache is being invalidate because project 0037aca1a5ff4640881ba886887b282b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:47.147595 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:47.148276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-959d58f0-602d-44f7-a079-a17ec61c202a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:47.149913 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1449/2881] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:47 2022] DELETE /identity/v3/projects/0037aca1a5ff4640881ba886887b282b => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:47.156323 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.156605 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.156872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.176901 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:47.178015 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:47.239982 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1433/2882] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:47.247619 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.248016 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.248292 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.269576 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:47.270777 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:47.278493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1450/2883] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:47.282638 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.292304 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3062e719-3f65-49e3-9051-13fda9fd7fd3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.297752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.298868 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.299138 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.299403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.300076 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:47.300375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.301984 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.314569 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1434/2884] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:47.318700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.327975 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2be59246-4e5e-4c47-9bb7-3516dbb652ba None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.332644 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.333245 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.333519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.333807 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.334407 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.336353 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.367712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1451/2885] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:47 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:47.368975 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.379720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f98367-38a5-458d-9fb7-a795daa49819 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.438265 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.438918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.439327 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.439439 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.440090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.442017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.463950 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1435/2886] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:47 2022] POST /identity/v3/users => generated 286 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:47.468025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.479469 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa4dbc7-3a2e-4c62-894f-815fcf76e03b admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.484099 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.484695 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.484971 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.485240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.486474 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.488109 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.498359 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1452/2887] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:47.506733 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.516763 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc18545-7eac-4958-8f3f-a72e6a3dc507 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.522577 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.523246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.523527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.523833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.524479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.526069 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c79db0b-5087-4b98-ba9f-932f5a6c1f94 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.537145 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1436/2888] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:47 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:47.541120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.551581 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918c7828-9779-40e3-af75-a90626ffe639 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.556164 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.556804 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.557082 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.557350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] PATH_INFO: `/v3/projects/ef4c95b5af834b3cadaf3c36e18cd154/users/18053f242c244622b51769bdda6f3709/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.571837 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] RBAC: Authorizing `identity:create_grant(project_id=ef4c95b5af834b3cadaf3c36e18cd154, user_id=18053f242c244622b51769bdda6f3709, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.574463 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.577756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:47.590523 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1453/2889] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:47 2022] PUT /identity/v3/projects/ef4c95b5af834b3cadaf3c36e18cd154/users/18053f242c244622b51769bdda6f3709/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:47.596003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256196e-85be-4bc6-b6c0-3bb3b40b91dd None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.596351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256196e-85be-4bc6-b6c0-3bb3b40b91dd None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.596679 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5256196e-85be-4bc6-b6c0-3bb3b40b91dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.615715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-5256196e-85be-4bc6-b6c0-3bb3b40b91dd None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:47.616945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-5256196e-85be-4bc6-b6c0-3bb3b40b91dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:47.643229 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:47.685345 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1437/2890] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:47.694750 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:47.696624 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:47.758095 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c472ca5-a94c-4128-b31f-2e023b26f4be admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:47.761698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:47.762297 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:47.762568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:47.762834 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:47.772473 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:47.773893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a9ab3d-ac28-46b8-925d-17d045c86fc1 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:47.784090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1454/2891] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:48.041351 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:48.041684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:48.042002 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:48.067366 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:48.068414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:48.152809 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:48.153384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:48.153513 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:48.169259 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1438/2892] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:02:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:48.183365 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:48.183918 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:48.184795 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:48.185310 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:48.193924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1455/2893] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:02:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:48.211146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:48.213005 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:48.280135 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0dcf38d-35cf-4e5e-a3d4-a64da1f3608a None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:48.289169 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:48.289861 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:48.290221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:48.290514 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:48.302869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:48.304627 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe1d805-1e04-41e6-a24e-88f51c916a82 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:48.316758 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1439/2894] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:48.331070 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e254738-bfe1-478a-ad60-19d182c760d3 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:48.342130 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:48.343209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:48.344953 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:48.345947 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:48.356374 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:48.359120 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669f3880-ea64-4b66-9ac1-f9f8fd624a60 service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:48.371289 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1456/2895] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:48 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:49.317144 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:49.317643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:49.317752 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:49.325363 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3921-7d24-4dfd-a5f2-ea3d52e89dc6 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:49.325893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3921-7d24-4dfd-a5f2-ea3d52e89dc6 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:49.325893 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334b3921-7d24-4dfd-a5f2-ea3d52e89dc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:49.355517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:49.358760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:49.373499 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1440/2896] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 05:02:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:49.380783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-334b3921-7d24-4dfd-a5f2-ea3d52e89dc6 None None] MFA Rules not processed for user `18053f242c244622b51769bdda6f3709`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:49.382520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-334b3921-7d24-4dfd-a5f2-ea3d52e89dc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:49.410278 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:49.443686 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b65b05a-f451-4d8b-b8bf-ac65f0866e82 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:49.463040 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:49.465303 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:49.466741 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:49.467655 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:49.503367 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:49.510309 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:49.529250 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1441/2897] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:49.559748 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1457/2898] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:49 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 231 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:49.567111 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:49.569124 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:49.665629 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:49.675152 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b2a36e-c5c5-4f8a-a383-ab2ce565dbe8 service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:49.684504 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4601933cc2c047a8920d7450c0ee4f56', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:49.685518 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:49.685872 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:49.686280 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:49.702404 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:49.705255 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:49.740908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1442/2899] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:49 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:49.949740 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a38-9401-4790-ac6c-e46798f611cd None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:49.950091 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a38-9401-4790-ac6c-e46798f611cd None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:49.950368 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de40a38-9401-4790-ac6c-e46798f611cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:49.974989 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-1de40a38-9401-4790-ac6c-e46798f611cd None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:49.976500 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1de40a38-9401-4790-ac6c-e46798f611cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:50.001127 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1458/2900] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:02:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:50.021051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:50.040680 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-928966a8-984d-46a6-b40f-b8e66a05bf6f service cinder] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:50.052476 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:50.053095 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:50.053373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:50.053646 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:50.080488 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:50.082401 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:50.118383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1443/2901] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:02:50.625987 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592b23-3cfa-4238-9904-22469240735b None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:50.627023 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592b23-3cfa-4238-9904-22469240735b None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:50.627146 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff592b23-3cfa-4238-9904-22469240735b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:50.635521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=100 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:50.648400 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-ff592b23-3cfa-4238-9904-22469240735b None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:50.649633 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-ff592b23-3cfa-4238-9904-22469240735b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:50.656977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1459/2902] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 05:02:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:50.679284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:50.690376 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06b6fec-3a8f-4e87-b82a-db0bb5083644 service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:50.695383 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:50.696003 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:50.696284 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:50.696555 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:50.705062 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:50.706632 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:50.714993 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1444/2903] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:02:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 05:02:51.372708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2e83-6cbe-4225-a65c-ba2c375ce79c None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:51.372708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2e83-6cbe-4225-a65c-ba2c375ce79c None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:51.372708 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11b2e83-6cbe-4225-a65c-ba2c375ce79c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:51.400230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-b11b2e83-6cbe-4225-a65c-ba2c375ce79c None None] MFA Rules not processed for user `18053f242c244622b51769bdda6f3709`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:51.401460 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b11b2e83-6cbe-4225-a65c-ba2c375ce79c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:51.408656 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1460/2904] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:53.165218 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:53.167558 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:53.184684 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d900c75-5268-4414-ad24-72c1e2ee00df service swift] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:53.194677 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:53.195474 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.195846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.196234 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] PATH_INFO: `/v3/users/b0470fab520f434e9848c9852ba10aca` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.197672 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] RBAC: Authorizing `identity:delete_user(user_id=b0470fab520f434e9848c9852ba10aca)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:53.203846 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:53.264199 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b0470fab520f434e9848c9852ba10aca'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.264883 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b0470fab520f434e9848c9852ba10aca'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.265564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b0470fab520f434e9848c9852ba10aca'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.278151 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b0470fab520f434e9848c9852ba10aca'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.285174 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b0470fab520f434e9848c9852ba10aca'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.298663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1445/2905] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:02:53 2022] DELETE /identity/v3/users/b0470fab520f434e9848c9852ba10aca => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:02:53.303081 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.303617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.303617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.332604 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:53.334079 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:53.409826 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1461/2906] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:53.420228 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:53.422200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:53.495268 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29006b6-74b9-419f-aa95-8b8ef33b464d admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:53.499097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:53.499833 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.500209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.500562 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.512906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:53.514869 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd338e3b-8073-4040-8022-fe1052f435b6 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:53.526050 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1446/2907] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:53.713756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:53.716756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:53.732312 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dff2d11-fd5b-471c-8b62-a973274d2022 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:53.740955 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:53.742250 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.742637 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.744101 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] PATH_INFO: `/v3/projects/eb27f70f1e564d178391319b7769d77f` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.746010 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb27f70f1e564d178391319b7769d77f)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:53.748019 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:53.808732 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb27f70f1e564d178391319b7769d77f', 'request_id': 'req-c93c6321-069e-420d-b279-58d98df31cab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.825648 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb27f70f1e564d178391319b7769d77f', 'request_id': 'req-c93c6321-069e-420d-b279-58d98df31cab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.834235 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb27f70f1e564d178391319b7769d77f', 'request_id': 'req-c93c6321-069e-420d-b279-58d98df31cab'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.845502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] The token cache is being invalidate because project eb27f70f1e564d178391319b7769d77f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:02:53.845781 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.846431 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-c93c6321-069e-420d-b279-58d98df31cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:02:53.847979 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1462/2908] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:02:53 2022] DELETE /identity/v3/projects/eb27f70f1e564d178391319b7769d77f => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:53.853227 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.853539 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.853814 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.875917 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:53.877812 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:53.920221 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:53.962946 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1447/2909] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:53.964382 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:53.964663 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:53.964940 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:53.987046 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:53.988295 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:54.004541 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1463/2910] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:02:54.007534 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.025442 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b7f3a7-c66c-4a6f-8210-3f7f6a04d819 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.031244 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.031900 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.032185 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.032496 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] PATH_INFO: `/v3/domains` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.034097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] RBAC: Adding query filter params (name=Default) {{(pid=87787) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 20 05:02:54.034097 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.035220 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.054091 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1448/2911] 10.222.0.42 () {58 vars in 1153 bytes} [Tue Sep 20 05:02:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 20 05:02:54.058519 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.069261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee5f358-8e4a-4a3f-8bb8-9ef51ef15a75 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.074309 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.074933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.075301 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.075742 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.076566 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.078643 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.118568 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1464/2912] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:54 2022] POST /identity/v3/projects => generated 371 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 20 05:02:54.122962 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.134805 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16119bdd-8231-4092-85fe-6c14287591ed admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.227519 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.228209 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.228436 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.228697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.229335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.231274 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.262780 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1449/2913] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:54 2022] POST /identity/v3/users => generated 286 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:54.265792 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.278475 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f88ecfd-0569-4509-869c-e7c1ccf82a4d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.283718 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.284350 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.284625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.284892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.285529 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.287123 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.305169 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1465/2914] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:54.309090 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.320663 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9df000a-314c-4d33-ac76-1c82aee5689e admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.326657 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.327478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.328051 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.328551 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] PATH_INFO: `/v3/roles` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.329449 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.331245 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bca139-c575-427d-906b-e291e0afc247 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.342749 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1450/2915] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:54 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:54.347502 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.357427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f2b93-2c89-4d88-8c95-8acb6b5a4d5d admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.362670 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.363304 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] REQUEST_METHOD: `PUT` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.363577 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.363875 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] PATH_INFO: `/v3/projects/dc4fae3b984a4982b1ce82a73661eccf/users/8431817a5ed9467f919df9e61707b684/roles/791fea6050e741c0824356b63aa26aea` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.381896 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc4fae3b984a4982b1ce82a73661eccf, user_id=8431817a5ed9467f919df9e61707b684, role_id=791fea6050e741c0824356b63aa26aea)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.387546 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.408387 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1466/2916] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:54 2022] PUT /identity/v3/projects/dc4fae3b984a4982b1ce82a73661eccf/users/8431817a5ed9467f919df9e61707b684/roles/791fea6050e741c0824356b63aa26aea => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:54.413452 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1b863-46a9-44df-89a1-c2aae3244d4f None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.413742 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1b863-46a9-44df-89a1-c2aae3244d4f None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.414017 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1b863-46a9-44df-89a1-c2aae3244d4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.433720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-3ae1b863-46a9-44df-89a1-c2aae3244d4f None None] MFA Rules not processed for user `f5af3cffbb0b41788f819ee8fb479d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:54.434948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-3ae1b863-46a9-44df-89a1-c2aae3244d4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:54.514319 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1451/2917] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:54.524914 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:54.526841 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:54.550944 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:54.607330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e75f79-75bc-4957-aacf-53dbb59872ce admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:54.613679 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:54.614384 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:54.614661 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:54.614927 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:54.629657 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:54.631421 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:54.642828 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1467/2918] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:02:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:02:59.358467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.359035 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.359180 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.396305 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] MFA Rules not processed for user `8431817a5ed9467f919df9e61707b684`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:02:59.397650 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:02:59.449447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:02:59.511765 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1452/2919] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:02:59 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:02:59.516330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.529347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12764419-2e65-4958-ab6f-548769cbb6d8 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.542201 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.542856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.543140 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.543411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] PATH_INFO: `/v3/projects` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.544237 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.546155 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.592754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1468/2920] 10.222.0.42 () {60 vars in 1153 bytes} [Tue Sep 20 05:02:59 2022] POST /identity/v3/projects => generated 371 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:59.597214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.611613 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-048cc04a-1861-4fab-84ba-b3084733f9d9 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.685996 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.686715 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.687053 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.687386 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] PATH_INFO: `/v3/users` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.688119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.690140 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.721437 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1453/2921] 10.222.0.42 () {60 vars in 1144 bytes} [Tue Sep 20 05:02:59 2022] POST /identity/v3/users => generated 292 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 20 05:02:59.722492 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.736712 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abe3fb0a-6e49-4eab-88d1-1a766b52db35 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.741652 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.742457 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.742736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.743035 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.743803 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.745346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.764938 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1469/2922] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 20 05:02:59.766146 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.777943 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b9c1a8-cc89-41e8-8ac1-c0c086638056 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.789277 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.791156 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.791479 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.791598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] PATH_INFO: `/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9/users/6c48a27c5df84410834c0b3fdcc1589c/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.808732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4dd3a44c0f4154b1345c90a6854fd9, user_id=6c48a27c5df84410834c0b3fdcc1589c, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.811409 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.828379 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1454/2923] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:59 2022] PUT /identity/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9/users/6c48a27c5df84410834c0b3fdcc1589c/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:02:59.832698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.843520 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483c3665-79bd-42f6-a028-a411d9e750e4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.911342 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.911634 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.911784 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.911977 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] PATH_INFO: `/v3/roles` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.912616 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.914216 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.925324 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1470/2924] 10.222.0.42 () {58 vars in 1122 bytes} [Tue Sep 20 05:02:59 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 20 05:02:59.928908 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:02:59.939489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13e906b-6109-464a-b522-15fff3554329 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:02:59.944914 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:02:59.945940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] REQUEST_METHOD: `PUT` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:02:59.945940 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:02:59.946212 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] PATH_INFO: `/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9/users/6c48a27c5df84410834c0b3fdcc1589c/roles/307985de8d134d4587aac9def1fcad5c` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:02:59.948139 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de4dd3a44c0f4154b1345c90a6854fd9, user_id=6c48a27c5df84410834c0b3fdcc1589c, role_id=307985de8d134d4587aac9def1fcad5c)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:02:59.950786 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:02:59.982453 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1455/2925] 10.222.0.42 () {60 vars in 1483 bytes} [Tue Sep 20 05:02:59 2022] PUT /identity/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9/users/6c48a27c5df84410834c0b3fdcc1589c/roles/307985de8d134d4587aac9def1fcad5c => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:03:05.614370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:05.616579 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:05.718172 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f791bd1-07c9-4955-826c-57d3a16e6228 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:05.740782 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:05.743793 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:05.744583 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:05.842409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:05.843181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:05.843557 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:05.844025 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:05.846780 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:05.863395 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:05.865717 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e1672b-5120-4c81-ba8a-05fe28fe381b service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:05.884084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1471/2926] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:03:05.891171 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc5768a-b9ce-48fb-aa9e-e76009bcdf76 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:05.898083 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:05.898862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:05.899147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:05.899421 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:05.901403 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:05.921026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:05.922945 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:05.943080 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1456/2927] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 20 05:03:06.836646 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538dca-74d2-4bc0-8999-09de72cdab16 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:06.837200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538dca-74d2-4bc0-8999-09de72cdab16 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:06.837200 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1538dca-74d2-4bc0-8999-09de72cdab16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:06.869259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-c1538dca-74d2-4bc0-8999-09de72cdab16 None None] MFA Rules not processed for user `6c48a27c5df84410834c0b3fdcc1589c`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:03:06.870540 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c1538dca-74d2-4bc0-8999-09de72cdab16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:06.941209 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1472/2928] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:03:06 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:03:06.954566 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:06.965593 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83d3203-8649-4717-8ead-e3588471382b service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:06.971671 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:06.972388 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:06.972730 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:06.973072 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:06.981307 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:07.030909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:07.033046 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:07.042064 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1457/2929] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:06 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:03:08.163556 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:08.164181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:08.164284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:08.185181 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] MFA Rules not processed for user `8431817a5ed9467f919df9e61707b684`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:03:08.186432 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:08.195190 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1473/2930] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:03:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:03:17.037879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=23 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:18.178524 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=64 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:18.301776 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:18.306090 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:18.308256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:18.314106 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4b783c-209f-4d2a-b30e-39200eac5a5c service nova] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:18.320548 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:18.321164 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:18.321446 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:18.321724 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:18.323597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:18.338454 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:18.340143 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3007384-dfc7-41bf-b84f-1644d99c9292 service nova] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:18.351248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1458/2931] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:03:18.395275 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c18c49-e955-489e-b70d-deb80988ee8f None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:18.399062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:18.399653 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:18.399960 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:18.400230 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:18.402080 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:18.472028 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:18.473505 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a724e3d-5dc7-4de7-ad54-67c6ad77e634 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:18.483774 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1474/2932] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:03:19.071142 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:19.071430 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:19.071803 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:19.090704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] MFA Rules not processed for user `18053f242c244622b51769bdda6f3709`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:03:19.091952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:19.150759 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1459/2933] 10.222.0.42 () {58 vars in 958 bytes} [Tue Sep 20 05:03:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:03:28.479697 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=50 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:29.143526 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=31 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:41.149331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] REQUEST_METHOD: `POST` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:41.149820 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:41.149935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:41.169427 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.auth.core [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87788) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:03:41.170627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:41.227240 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1475/2934] 10.222.0.42 () {58 vars in 1009 bytes} [Tue Sep 20 05:03:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 20 05:03:41.248921 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:41.250341 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:41.318520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71257745-27ef-4f7a-81be-425078318bf3 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:41.323375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:41.324028 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:41.324308 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:41.324581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:41.333362 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:41.334877 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf549b5-1a2a-42c3-8d99-d713532c7074 service swift] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:41.342941 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1460/2935] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:03:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:03:43.435700 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:43.446929 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1cb8fe-cd90-4634-9275-b02e7bdc07b1 None None] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:43.450584 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:43.451192 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:43.451468 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:43.451754 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:43.462017 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:43.463521 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:43.474159 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1476/2936] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:03:43 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:03:51.339701 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=32 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:53.469397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=31 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:03:56.703754 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:56.704739 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:56.704842 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:56.724647 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:03:56.725848 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:56.733137 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1461/2937] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 05:03:56 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:03:56.745039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:56.756347 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d77a0-4a69-4e10-a097-a74eefbf0ae1 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:56.761188 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:56.761766 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:56.762039 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:56.762302 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:56.770598 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:56.772258 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:56.780011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1477/2938] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:03:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 20 05:03:58.663455 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:58.665039 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:03:58.729935 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e15d9b1-0f29-4490-a99f-ff37442208a6 None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:58.734329 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:58.734948 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:58.735248 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:58.735529 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] PATH_INFO: `/v3/users/18053f242c244622b51769bdda6f3709` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:58.736661 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18053f242c244622b51769bdda6f3709)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:58.738564 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:58.782772 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18053f242c244622b51769bdda6f3709'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:58.783410 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18053f242c244622b51769bdda6f3709'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:58.784031 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18053f242c244622b51769bdda6f3709'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:58.795719 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18053f242c244622b51769bdda6f3709'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:58.802411 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-ffbf8b60-3c6c-462d-856b-4a0213702728 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18053f242c244622b51769bdda6f3709'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:58.814668 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1462/2939] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:03:58 2022] DELETE /identity/v3/users/18053f242c244622b51769bdda6f3709 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:03:58.982973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:03:58.994231 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ece91e-7cc1-4652-9a74-a6f50f7e4702 service swift] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:03:59.056108 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:03:59.056736 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:03:59.057011 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:03:59.057272 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] PATH_INFO: `/v3/projects/ef4c95b5af834b3cadaf3c36e18cd154` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:03:59.058380 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ef4c95b5af834b3cadaf3c36e18cd154)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:03:59.060306 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:03:59.105761 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ef4c95b5af834b3cadaf3c36e18cd154', 'request_id': 'req-830d8e5f-293b-44fe-a118-4c278d425db4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:59.112883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ef4c95b5af834b3cadaf3c36e18cd154', 'request_id': 'req-830d8e5f-293b-44fe-a118-4c278d425db4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:59.119122 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ef4c95b5af834b3cadaf3c36e18cd154', 'request_id': 'req-830d8e5f-293b-44fe-a118-4c278d425db4'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:59.130857 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] The token cache is being invalidate because project ef4c95b5af834b3cadaf3c36e18cd154 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:03:59.131138 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:59.131783 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:03:59.133222 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1478/2940] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:03:58 2022] DELETE /identity/v3/projects/ef4c95b5af834b3cadaf3c36e18cd154 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:04:08.810697 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=56,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:04:09.127330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=57,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:05:58.579363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] REQUEST_METHOD: `POST` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:05:58.579855 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:05:58.579968 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:05:58.599573 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.auth.core [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] MFA Rules not processed for user `51c05b0002454c93a8c2ffbd0cef784d`. Rule list: `[]` (Enabled: `True`). {{(pid=87787) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 20 05:05:58.600798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:05:58.668295 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1463/2941] 10.222.0.42 () {58 vars in 967 bytes} [Tue Sep 20 05:05:58 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 20 05:05:58.715856 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:05:58.717346 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:05:58.785680 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d8e5f-293b-44fe-a118-4c278d425db4 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:05:58.790638 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'be18420a973d4c8ab00a488d465cdd03', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:05:58.791239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:05:58.791517 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:05:58.791817 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:05:58.799954 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:05:58.802088 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:05:58.810001 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1479/2942] 10.222.0.42 () {60 vars in 1384 bytes} [Tue Sep 20 05:05:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 20 05:06:05.344414 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:05.345970 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:05.415893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be653fd6-f0c1-4bab-bfd6-39760fcddc9b None None] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:05.420528 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:05.421172 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:05.421448 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:05.421720 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] PATH_INFO: `/v3/users/af3994f5477a4a2392607ee59ae684a8` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:05.422879 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] RBAC: Authorizing `identity:delete_user(user_id=af3994f5477a4a2392607ee59ae684a8)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:05.424830 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:05.479581 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'af3994f5477a4a2392607ee59ae684a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.480263 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'af3994f5477a4a2392607ee59ae684a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.480862 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'af3994f5477a4a2392607ee59ae684a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.493395 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'af3994f5477a4a2392607ee59ae684a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.500375 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'af3994f5477a4a2392607ee59ae684a8'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.513257 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1464/2943] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:06:05 2022] DELETE /identity/v3/users/af3994f5477a4a2392607ee59ae684a8 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:06:05.684839 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:05.697924 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89abb2d-551c-4d9d-8901-eb66973ef8d2 service swift] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:05.760255 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:05.760846 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:05.761125 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:05.761396 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] PATH_INFO: `/v3/projects/a243c50cd9744b96b39e4835e4a4f8b5` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:05.762511 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a243c50cd9744b96b39e4835e4a4f8b5)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:05.764472 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:05.810063 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a243c50cd9744b96b39e4835e4a4f8b5', 'request_id': 'req-e7d522ab-872a-4719-8990-20b5a652768c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.817660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a243c50cd9744b96b39e4835e4a4f8b5', 'request_id': 'req-e7d522ab-872a-4719-8990-20b5a652768c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.824484 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a243c50cd9744b96b39e4835e4a4f8b5', 'request_id': 'req-e7d522ab-872a-4719-8990-20b5a652768c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.835477 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] The token cache is being invalidate because project a243c50cd9744b96b39e4835e4a4f8b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:06:05.835788 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.836470 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.838031 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1480/2944] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:06:05 2022] DELETE /identity/v3/projects/a243c50cd9744b96b39e4835e4a4f8b5 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:06:05.841967 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:05.843447 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:05.857148 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec2955-778b-404b-aa82-80b9af028cef admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:05.877492 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:05.917465 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:05.918099 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:05.918374 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:05.918641 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] PATH_INFO: `/v3/users/fb5dd335d94b4fae86d3b62c83f036bc` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:05.919798 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb5dd335d94b4fae86d3b62c83f036bc)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:05.921700 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:05.968826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb5dd335d94b4fae86d3b62c83f036bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.969467 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb5dd335d94b4fae86d3b62c83f036bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.970058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb5dd335d94b4fae86d3b62c83f036bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.981847 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb5dd335d94b4fae86d3b62c83f036bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:05.988698 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb5dd335d94b4fae86d3b62c83f036bc'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.001732 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1465/2945] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:06:05 2022] DELETE /identity/v3/users/fb5dd335d94b4fae86d3b62c83f036bc => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 20 05:06:06.171436 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:06.173056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:06.185610 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d522ab-872a-4719-8990-20b5a652768c admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:06.203532 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:06.245299 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:06.245934 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:06.246241 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:06.246512 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] PATH_INFO: `/v3/projects/58041930da9a453f8b30313ad0b7b31c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:06.247627 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] RBAC: Authorizing `identity:delete_project(project_id=58041930da9a453f8b30313ad0b7b31c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:06.249906 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:06.295615 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58041930da9a453f8b30313ad0b7b31c', 'request_id': 'req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.302892 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58041930da9a453f8b30313ad0b7b31c', 'request_id': 'req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.309259 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58041930da9a453f8b30313ad0b7b31c', 'request_id': 'req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.320037 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] The token cache is being invalidate because project 58041930da9a453f8b30313ad0b7b31c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87788) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:06:06.320318 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.320933 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:06:06.322370 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1481/2946] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:06:06 2022] DELETE /identity/v3/projects/58041930da9a453f8b30313ad0b7b31c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:06:15.945321 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:15.946704 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:16.014398 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb725a28-cb8a-4c4f-af38-3df98f409fce admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:16.057260 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:16.074200 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:16.074750 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:16.075026 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:16.075297 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:16.077041 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:16.088652 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:16.090214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:16.100598 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1466/2947] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:06:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:06:16.316423 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:26.095751 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=11 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:26.196669 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:26.198084 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:26.261139 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0c46d61-26a3-4e7a-bff8-40cb1a824dcf admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:26.264683 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:26.265276 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:26.265548 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:26.265815 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:26.267514 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:26.277377 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:26.278782 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:26.286553 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1482/2948] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:06:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:06:26.398214 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:26.407373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23fc9938-6a6e-4b6c-8eba-5aef1d7277ff service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:26.411836 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:26.412549 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:26.412831 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:26.413103 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:26.414827 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:26.424863 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:26.426281 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:26.434690 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1467/2949] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:06:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:06:26.542689 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:06:26.544256 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:26.554973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d428aa2-1c12-4a7b-9cfa-a4c6fffde2dc service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:06:26.558725 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:06:26.559323 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:06:26.559596 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:06:26.559901 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:06:26.561592 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:06:26.635048 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:06:26.636409 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:06:26.647056 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1483/2950] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:06:26 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:06:36.430777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=6 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:06:36.642305 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=60 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:17.038361 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:17.047181 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c7248-1ac7-47f3-8b94-3981c4bfec74 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:17.050762 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:17.051363 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:17.051645 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:17.051952 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:17.053682 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:17.111547 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:17.113005 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:17.121875 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1468/2951] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:18.220476 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:18.221910 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:18.235775 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aac21f-62e1-48e3-a3ca-fa9c3eb5cf45 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:18.244583 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:18.245608 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:18.246672 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:18.247134 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:18.249269 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:18.264317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:18.266411 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:18.281621 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1484/2952] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:18.445036 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:18.460121 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943648ab-a327-4aba-96f4-2c82bb682145 service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:18.465541 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:18.466352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:18.466643 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:18.467058 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:18.469131 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:18.484147 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:18.485821 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:18.499597 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1469/2953] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:19.481420 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:19.492163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685e86f7-3d3e-4065-a51e-bfdbc431140e service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:19.496441 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:19.497049 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:19.497317 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:19.497582 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:19.499319 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:19.510755 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:19.512210 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:19.520964 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1485/2954] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:19.700335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:19.709084 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f8e0bf-24c9-4126-843d-95c0e888da7d service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:19.712865 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:19.713451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:19.713725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:19.713994 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:19.715747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:19.729246 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:19.730685 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:19.741747 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1470/2955] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:20.927935 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:20.930141 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:20.950660 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d368dcc-7690-4a4e-8f16-acba7ceeed31 service neutron] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:20.956456 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '697f2e9daa334a068f10a5ba0671aed6', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['member', 'service', 'reader', 'ResellerAdmin', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:20.957061 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:20.957366 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:20.957922 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:20.959662 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:20.972949 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:20.974533 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:20.994062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1486/2956] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:20 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:22.232582 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:22.241320 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb1820ff-d232-4d80-8cf9-17aac413211b service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:22.244902 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fff72313d3f14d8abbe9db7bf6e0501b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:22.245527 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:22.245793 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:22.246063 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:22.247795 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:22.309909 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:22.311331 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:22.320726 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1471/2957] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:25.332119 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:25.333567 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:25.347871 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c78a05-3c6f-4b17-912e-f0e0a491cd1c service nova] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:25.353994 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:25.355951 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:25.356392 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:25.356818 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:25.359354 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:25.373397 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:25.375331 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:25.398946 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1487/2958] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:25 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:28.460477 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:28.476602 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e209003c-f0b6-4ea1-b762-4b32a684b45f service neutron] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:28.481727 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:28.482335 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] REQUEST_METHOD: `GET` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:28.482619 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:28.482893 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:28.484725 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:28.496906 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:28.498478 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:28.509160 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1472/2959] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:08:28 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:08:28.528173 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:28.529617 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:28.545998 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14573fe8-42a8-4230-8141-81c9c09ab7be service placement] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:28.550560 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:28.551191 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:28.551471 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:28.551813 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] PATH_INFO: `/v3/users/8431817a5ed9467f919df9e61707b684` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:28.552973 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8431817a5ed9467f919df9e61707b684)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:28.554883 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:28.603217 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8431817a5ed9467f919df9e61707b684'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.603923 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8431817a5ed9467f919df9e61707b684'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.604531 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8431817a5ed9467f919df9e61707b684'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.611499 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8431817a5ed9467f919df9e61707b684'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.623722 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8431817a5ed9467f919df9e61707b684'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.637062 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1488/2960] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:08:28 2022] DELETE /identity/v3/users/8431817a5ed9467f919df9e61707b684 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:08:28.806482 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:28.817777 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb0c9d-9101-46e0-92d1-5fc9c13fa223 service placement] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:28.867818 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=100 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:28.877656 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:28.878302 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:28.878579 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:28.878845 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] PATH_INFO: `/v3/projects/dc4fae3b984a4982b1ce82a73661eccf` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:28.880235 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc4fae3b984a4982b1ce82a73661eccf)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:28.882119 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:28.926826 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc4fae3b984a4982b1ce82a73661eccf', 'request_id': 'req-d42acef5-7922-4efb-aa4d-49f1fa844230'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.933373 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc4fae3b984a4982b1ce82a73661eccf', 'request_id': 'req-d42acef5-7922-4efb-aa4d-49f1fa844230'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.938838 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc4fae3b984a4982b1ce82a73661eccf', 'request_id': 'req-d42acef5-7922-4efb-aa4d-49f1fa844230'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.951451 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] The token cache is being invalidate because project dc4fae3b984a4982b1ce82a73661eccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:08:28.951760 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.952489 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:28.953942 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1473/2961] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:08:28 2022] DELETE /identity/v3/projects/dc4fae3b984a4982b1ce82a73661eccf => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:08:28.957991 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:28.959549 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:28.972675 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf7d23a-4bd0-4b95-a807-f23b8051cb19 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:29.028330 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:29.028980 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:29.029261 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:29.029534 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] PATH_INFO: `/v3/users/6c48a27c5df84410834c0b3fdcc1589c` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:29.030668 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6c48a27c5df84410834c0b3fdcc1589c)` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:29.032614 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:29.053885 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:29.082493 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6c48a27c5df84410834c0b3fdcc1589c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.083137 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6c48a27c5df84410834c0b3fdcc1589c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.083756 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6c48a27c5df84410834c0b3fdcc1589c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.090698 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6c48a27c5df84410834c0b3fdcc1589c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.102249 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.notifications [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6c48a27c5df84410834c0b3fdcc1589c'} {{(pid=87788) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.115050 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1489/2962] 10.222.0.42 () {58 vars in 1224 bytes} [Tue Sep 20 05:08:28 2022] DELETE /identity/v3/users/6c48a27c5df84410834c0b3fdcc1589c => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:08:29.289587 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Authenticating user token {{(pid=87787) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:08:29.291252 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.fernet_utils [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87787) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:08:29.307524 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42acef5-7922-4efb-aa4d-49f1fa844230 admin admin] Validating token access rules against request {{(pid=87787) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:08:29.362669 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f5af3cffbb0b41788f819ee8fb479d3a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '8b96017b54824414bda6d5bbb2079fd6', 'project_domain_id': 'default', 'roles': ['member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87787) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:08:29.363300 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] REQUEST_METHOD: `DELETE` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:08:29.363580 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] SCRIPT_NAME: `/identity` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:08:29.363886 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] PATH_INFO: `/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9` {{(pid=87787) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:08:29.365059 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] RBAC: Authorizing `identity:delete_project(project_id=de4dd3a44c0f4154b1345c90a6854fd9)` {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:08:29.367096 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] RBAC: Authorization granted {{(pid=87787) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:08:29.412372 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de4dd3a44c0f4154b1345c90a6854fd9', 'request_id': 'req-5d8b6d7a-3712-45bf-8de7-1923fd72047e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.418874 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de4dd3a44c0f4154b1345c90a6854fd9', 'request_id': 'req-5d8b6d7a-3712-45bf-8de7-1923fd72047e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.424352 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de4dd3a44c0f4154b1345c90a6854fd9', 'request_id': 'req-5d8b6d7a-3712-45bf-8de7-1923fd72047e'} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.436608 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] The token cache is being invalidate because project de4dd3a44c0f4154b1345c90a6854fd9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=87787) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 20 05:08:29.436899 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.437520 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG keystone.notifications [None req-5d8b6d7a-3712-45bf-8de7-1923fd72047e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=87787) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 20 05:08:29.438999 dv-cinder-756710-7-smb devstack@keystone.service[87787]: [pid: 87787|app: 0|req: 1474/2963] 10.222.0.42 () {58 vars in 1233 bytes} [Tue Sep 20 05:08:29 2022] DELETE /identity/v3/projects/de4dd3a44c0f4154b1345c90a6854fd9 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 20 05:08:39.111516 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:08:39.433517 dv-cinder-756710-7-smb devstack@keystone.service[87787]: DEBUG dbcounter [-] [87787] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=87787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 20 05:11:19.905149 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Authenticating user token {{(pid=87788) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 20 05:11:19.906574 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:11:20.042507 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96fc558-a6e9-472b-9723-164c01b82eb6 admin admin] Validating token access rules against request {{(pid=87788) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 20 05:11:20.100284 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'b4740fea42bb4ac3878d893eeea5900b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'c2a7a7ae486945b9badf809df5cfdcf2', 'project_domain_id': 'default', 'roles': ['service', 'member', 'admin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=87788) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 20 05:11:20.100886 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] REQUEST_METHOD: `GET` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 20 05:11:20.101163 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] SCRIPT_NAME: `/identity` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 20 05:11:20.101435 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=87788) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 20 05:11:20.103126 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.fernet_utils [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=87788) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 20 05:11:20.114239 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 20 05:11:20.115847 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009186c2-7295-4bf5-8d14-dd5dc7f7a2c1 service placement] RBAC: Authorization granted {{(pid=87788) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 20 05:11:20.126625 dv-cinder-756710-7-smb devstack@keystone.service[87788]: [pid: 87788|app: 0|req: 1490/2964] 10.222.0.42 () {60 vars in 1365 bytes} [Tue Sep 20 05:11:19 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 20 05:11:30.122337 dv-cinder-756710-7-smb devstack@keystone.service[87788]: DEBUG dbcounter [-] [87788] Writing DB stats keystone:SELECT=89 {{(pid=87788) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}